{"plan_idx": 0, "title": "spicy-tomato-anchovy-pasta", "question_idx": 0, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 8 happen before Step 10?", "why_question": "Why must Step 8 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 8 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, step 8 must happen before step 10 because the pasta needs to be tossed with the anchovy mixture and chilli flakes before serving immediately.\"\n}"}
{"plan_idx": 1, "title": "one-pot irish stew", "question_idx": 1, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 8 because the stew needs to be fully cooked before serving.\"\n}"}
{"plan_idx": 2, "title": "easy strawberry tart", "question_idx": 2, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tart needs to be well set before serving with whipped cream.\"\n}"}
{"plan_idx": 3, "title": "almond and apple cake", "question_idx": 3, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 8 because the ground almonds need to be stirred in before adding the flour and milk.\"\n}"}
{"plan_idx": 4, "title": "chocolate-chocolate-cake", "question_idx": 4, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 20], "binary_question": "Must Step 1 happen before Step 21?", "why_question": "Why must Step 1 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 1 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 21 because the cake needs to be preheated before it can be baked, and the cooling process cannot begin until the cake is baked.\"\n}"}
{"plan_idx": 5, "title": "fusilli-and-meatballs", "question_idx": 5, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 16], "binary_question": "Must Step 5 happen before Step 17?", "why_question": "Why must Step 5 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 5 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tomatoes need to be processed and added to the saucepan before the meatballs are added to the tomato sauce.\"\n}"}
{"plan_idx": 6, "title": "spiced butternut squash soup", "question_idx": 6, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 14], "binary_question": "Must Step 2 happen before Step 15?", "why_question": "Why must Step 2 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 2 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 can happen after Step 2, as the seasoning and adding of sherry, cream, and milk occurs after the squash has been baked and prepared.\" \n}"}
{"plan_idx": 7, "title": "spiced butternut squash soup", "question_idx": 7, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 14], "binary_question": "Must Step 4 happen before Step 15?", "why_question": "Why must Step 4 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 4 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be cooked before it can be added to the soup and seasoned.\"\n}"}
{"plan_idx": 8, "title": "vegetable-terrine", "question_idx": 8, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 5 happen before Step 11?", "why_question": "Why must Step 5 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cream mixture needs to be prepared before arranging the vegetables in the terrine.\"\n}"}
{"plan_idx": 9, "title": "almond and apple cake", "question_idx": 9, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The remaining flour and milk cannot be added until the first half is well combined.\"\n}"}
{"plan_idx": 10, "title": "jam-drop-biscuits", "question_idx": 10, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 4 because the dough needs to be formed and chilled before it can be rolled into balls and coated with hazelnuts.\"\n}"}
{"plan_idx": 11, "title": "scone-pastry", "question_idx": 11, "steps": ["Sift the flour, baking powder and salt into a bowl.", "Add the butter and rub in until the mixture resembles fine crumbs.", "Make a well in the centre and add the milk.", "Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.", "Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: scone-pastry\n\nProcedure:\n1. Sift the flour, baking powder and salt into a bowl.\n2. Add the butter and rub in until the mixture resembles fine crumbs.\n3. Make a well in the centre and add the milk.\n4. Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.\n5. Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 5 because the dough needs to be mixed with milk before it is kneaded and rolled out.\"\n}"}
{"plan_idx": 12, "title": "green-tofu-curry", "question_idx": 12, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to prepare the rice before bringing it to a boil in Step 2.\"\n}"}
{"plan_idx": 13, "title": "chicory-and-roquefort-salad", "question_idx": 13, "steps": ["In a bowl, toss chicory, Roquefort and pecan nuts together.", "Make the dressing by mixing together cream cheese, yoghurt and salt and pepper.", "Drizzle over salad."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicory-and-roquefort-salad\n\nProcedure:\n1. In a bowl, toss chicory, Roquefort and pecan nuts together.\n2. Make the dressing by mixing together cream cheese, yoghurt and salt and pepper.\n3. Drizzle over salad.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 3 because the dressing needs to be made before it can be drizzled over the salad.\"\n}"}
{"plan_idx": 14, "title": "fusilli-and-meatballs", "question_idx": 14, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [14, 19], "binary_question": "Must Step 15 happen before Step 20?", "why_question": "Why must Step 15 happen before Step 20?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 15 happen before Step 20?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be cooked before being added to the pasta and sauce.\"\n}"}
{"plan_idx": 15, "title": "very-vanilla-ry-cheesecake", "question_idx": 15, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 12], "binary_question": "Must Step 10 happen before Step 13?", "why_question": "Why must Step 10 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 10 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cheesecake needs to be baked before it can be refrigerated.\"\n}"}
{"plan_idx": 16, "title": "simple-basic-cupcakes", "question_idx": 16, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 must happen before Step 4 because the cake needs to be fully baked before checking if it's done and adding more milk if needed.\"\n}"}
{"plan_idx": 17, "title": "scone-pastry", "question_idx": 17, "steps": ["Sift the flour, baking powder and salt into a bowl.", "Add the butter and rub in until the mixture resembles fine crumbs.", "Make a well in the centre and add the milk.", "Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.", "Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: scone-pastry\n\nProcedure:\n1. Sift the flour, baking powder and salt into a bowl.\n2. Add the butter and rub in until the mixture resembles fine crumbs.\n3. Make a well in the centre and add the milk.\n4. Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.\n5. Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 5 because the dough needs to be at the right consistency before it can be transferred to a lightly floured surface and kneaded.\" \n}"}
{"plan_idx": 18, "title": "white bread", "question_idx": 18, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 7 because the dough needs to rise before it can be covered and allowed to rise further.\"\n}"}
{"plan_idx": 19, "title": "jam-drop-biscuits", "question_idx": 19, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 1 happen before Step 5?", "why_question": "Why must Step 1 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 1 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 1 must happen before Step 5 because the dough needs to be prepared and chilled before forming the balls and making the hollows for the jam.\"\n}"}
{"plan_idx": 20, "title": "curried bbq mussels", "question_idx": 20, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 9 because the mussels need to be wrapped tightly in foil before cooking on the barbecue.\"\n}"}
{"plan_idx": 21, "title": "tangy-gammon-in-cider", "question_idx": 21, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tomatoes need to be prepared before they can be added to the gammon steaks in Step 6.\"\n}"}
{"plan_idx": 22, "title": "brown sugar shortbread", "question_idx": 22, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 4 happen before Step 10?", "why_question": "Why must Step 4 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 4 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 10 because the dough needs to be mixed well before it is rolled out and baked.\"\n}"}
{"plan_idx": 23, "title": "spicy-tomato-anchovy-pasta", "question_idx": 23, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The linguine needs to be cooked before it can be drained and tossed with the anchovy mixture.\"\n}"}
{"plan_idx": 24, "title": "spiced-pumpkin-teabread", "question_idx": 24, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 9 happen before Step 13?", "why_question": "Why must Step 9 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 9 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen after Step 9, as it is not dependent on the order of the two steps.\"\n}"}
{"plan_idx": 25, "title": "vegetable-terrine", "question_idx": 25, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 14], "binary_question": "Must Step 10 happen before Step 15?", "why_question": "Why must Step 10 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 must happen before Step 15 because the terrine needs to be refrigerated to set before it can be served chilled.\"\n}"}
{"plan_idx": 26, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 26, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 15], "binary_question": "Must Step 4 happen before Step 16?", "why_question": "Why must Step 4 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 4 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 is necessary to create the dough for the shortcakes before assembling the final dessert in Step 16.\"\n}"}
{"plan_idx": 27, "title": "chocolate-chocolate-cake", "question_idx": 27, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 21], "binary_question": "Must Step 10 happen before Step 22?", "why_question": "Why must Step 10 happen before Step 22?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen before Step 22?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, step 22 can happen after step 10 as it is for decoration and does not affect the baking process.\"\n}"}
{"plan_idx": 28, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 28, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not need to happen before Step 6 because the tomatoes can be seasoned and set aside while the lentils are cooking, and then mixed with the lentils before serving.\"\n}"}
{"plan_idx": 29, "title": "fusilli-and-meatballs", "question_idx": 29, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 19], "binary_question": "Must Step 11 happen before Step 20?", "why_question": "Why must Step 11 happen before Step 20?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen before Step 20?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 does not need to happen before Step 20 because they are independent processes.\"\n}"}
{"plan_idx": 30, "title": "almond and apple cake", "question_idx": 30, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 8 happen before Step 13?", "why_question": "Why must Step 8 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen before Step 8 because Step 13 is about cooling the cake after baking, while Step 8 is about mixing the ingredients.\" \n}"}
{"plan_idx": 31, "title": "spiced butternut squash soup", "question_idx": 31, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 12], "binary_question": "Must Step 7 happen before Step 13?", "why_question": "Why must Step 7 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be mashed with the potatoes before pureeing the soup.\"\n}"}
{"plan_idx": 32, "title": "vegetable-terrine", "question_idx": 32, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 14], "binary_question": "Must Step 6 happen before Step 15?", "why_question": "Why must Step 6 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 6 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cream mixture needs to be prepared and poured into the mould before the terrine can be refrigerated and served.\" \n}"}
{"plan_idx": 33, "title": "shellabina-s-corned-beef-hash", "question_idx": 33, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 4 because the corned beef needs to simmer with the vegetables before adding the gravy granules to thicken the stew.\"\n}"}
{"plan_idx": 34, "title": "white bread", "question_idx": 34, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 8 because the dough needs to rise before it can be punched down.\"\n}"}
{"plan_idx": 35, "title": "creamy-chayote-squash-soup", "question_idx": 35, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 1 happen before Step 5?", "why_question": "Why must Step 1 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 1 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 5 because the stock needs to be dissolved before it can be added to the mixture in Step 5.\"\n}"}
{"plan_idx": 36, "title": "balsamic-and-mozzarella-chicken", "question_idx": 36, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 can happen before Step 6 as the arrangement of mozzarella, basil, and tomato can be done after the chicken is cooked and before it is served.\"\n}"}
{"plan_idx": 37, "title": "cloud-bread", "question_idx": 37, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 6 must happen before Step 8 because the batter needs to be folded and prepared before baking.\" \n}"}
{"plan_idx": 38, "title": "vegetable-terrine", "question_idx": 38, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 10 happen before Step 11?", "why_question": "Why must Step 10 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 10 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 must happen before Step 11 because the cream mixture needs to be poured into the mould before arranging the vegetables.\" \n}"}
{"plan_idx": 39, "title": "black-rice-pudding", "question_idx": 39, "steps": ["Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.", "Bring to the boil over high heat, stirring frequently.", "Reduce heat to medium-low.", "Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.", "Stir in coconut cream and vanilla extract.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: black-rice-pudding\n\nProcedure:\n1. Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.\n2. Bring to the boil over high heat, stirring frequently.\n3. Reduce heat to medium-low.\n4. Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.\n5. Stir in coconut cream and vanilla extract.\n6. Serve warm.\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 2 because the rice needs to be rinsed and combined with sugar and water before it can be brought to a boil.\"\n}"}
{"plan_idx": 40, "title": "balsamic-and-mozzarella-chicken", "question_idx": 40, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 5 because the chicken needs to be saut\u00e9ed in the frying pan after being coated with oil.\"\n}"}
{"plan_idx": 41, "title": "lightly spiced tomato and red lentil soup", "question_idx": 41, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 1 happen before Step 11?", "why_question": "Why must Step 1 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 1 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 11 because the oil needs to be heated before the soup can be reheated.\"\n}"}
{"plan_idx": 42, "title": "white bread", "question_idx": 42, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 9 happen before Step 11?", "why_question": "Why must Step 9 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 9 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 11 because punching the dough down and kneading it again is necessary before shaping it into loaves.\"\n}"}
{"plan_idx": 43, "title": "spiced-pumpkin-teabread", "question_idx": 43, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 12], "binary_question": "Must Step 5 happen before Step 13?", "why_question": "Why must Step 5 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 5 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 13 because the honey is added to the pumpkin mixture in Step 5, and then brushed onto the teabread in Step 13.\"\n}"}
{"plan_idx": 44, "title": "chicken and vegetable pie", "question_idx": 44, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 15], "binary_question": "Must Step 8 happen before Step 16?", "why_question": "Why must Step 8 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 8 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The hot liquid mixture needs to be poured over the chicken mixture before baking in the oven.\"\n}"}
{"plan_idx": 45, "title": "slow cooker butter chicken", "question_idx": 45, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen before Step 6 because seasoning to taste with salt can be done at any point during the cooking process.\"\n}"}
{"plan_idx": 46, "title": "brown sugar shortbread", "question_idx": 46, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the butter and brown sugar need to be creamed before adding the flour and kneading the dough.\"\n}"}
{"plan_idx": 47, "title": "one-pot irish stew", "question_idx": 47, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 1 happen before Step 4?", "why_question": "Why must Step 1 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 1 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 4 because the first batch of potatoes needs to cook and break up to thicken the stew before adding the remaining potatoes and carrots.\"\n}"}
{"plan_idx": 48, "title": "creamy-chayote-squash-soup", "question_idx": 48, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 6 because the stock needs to be stirred in before covering and simmering the soup for 20 minutes.\"\n}"}
{"plan_idx": 49, "title": "fusilli-and-meatballs", "question_idx": 49, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [15, 16], "binary_question": "Must Step 16 happen before Step 17?", "why_question": "Why must Step 16 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 16 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be browned before being added to the tomato sauce to ensure they are fully cooked and have a nice texture.\"\n}"}
{"plan_idx": 50, "title": "white bread", "question_idx": 50, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 3 happen before Step 10?", "why_question": "Why must Step 3 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 3 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not need to happen before Step 10 because Step 10 involves kneading the dough, while Step 3 involves mixing salt and oil into the yeast mixture.\" \n}"}
{"plan_idx": 51, "title": "fusilli-and-meatballs", "question_idx": 51, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 20], "binary_question": "Must Step 3 happen before Step 21?", "why_question": "Why must Step 3 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 3 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not need to happen before Step 21 because they are independent of each other and can happen in any order.\"\n}"}
{"plan_idx": 52, "title": "one-pot irish stew", "question_idx": 52, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 2 happen before Step 7?", "why_question": "Why must Step 2 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 2 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen after Step 2, as it is the final step in the procedure and does not depend on the timing of Step 2.\"\n}"}
{"plan_idx": 53, "title": "spiced butternut squash soup", "question_idx": 53, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 14], "binary_question": "Must Step 7 happen before Step 15?", "why_question": "Why must Step 7 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The butter needs to be melted before adding the spices and other ingredients in Step 15.\"\n}"}
{"plan_idx": 54, "title": "white bread", "question_idx": 54, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 7 happen before Step 9?", "why_question": "Why must Step 7 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 7 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 9 because the dough needs to rise before it can be punched down.\"\n}"}
{"plan_idx": 55, "title": "lamb-curry--serves-4-", "question_idx": 55, "steps": ["Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.", "Fry the lamb in a little oil, then add the remaining onion.", "Gently fry for a minute, then add the paste and cook for a couple of minutes.", "Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.", "Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lamb-curry--serves-4-\n\nProcedure:\n1. Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.\n2. Fry the lamb in a little oil, then add the remaining onion.\n3. Gently fry for a minute, then add the paste and cook for a couple of minutes.\n4. Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.\n5. Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 5 because the ingredients added in Step 4 need time to simmer and become tender before adding the fresh tomatoes and spinach in Step 5.\"\n}"}
{"plan_idx": 56, "title": "lightly spiced tomato and red lentil soup", "question_idx": 56, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 8 because the bay leaf needs to be removed from the soup before blending.\" \n}"}
{"plan_idx": 57, "title": "spiced-pumpkin-teabread", "question_idx": 57, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 12], "binary_question": "Must Step 11 happen before Step 13?", "why_question": "Why must Step 11 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 11 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen before Step 13 because the teabread needs to be baked and allowed to cool before being brushed with honey.\"\n}"}
{"plan_idx": 58, "title": "strawberries-in-pimm-s", "question_idx": 58, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 4 happen before Step 6?", "why_question": "Why must Step 4 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 4 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the Pimm's needs time to infuse the strawberries before garnishing with mint leaves.\"\n}"}
{"plan_idx": 59, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 59, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 1 happen before Step 10?", "why_question": "Why must Step 1 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 1 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 10 because the onions need to be cooked before serving the dish.\"\n}"}
{"plan_idx": 60, "title": "chocolate-chocolate-cake", "question_idx": 60, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 15], "binary_question": "Must Step 12 happen before Step 16?", "why_question": "Why must Step 12 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, step 16 can happen before step 12 as the order of these steps does not affect the outcome of the cake.\"\n}"}
{"plan_idx": 61, "title": "simple-basic-cupcakes", "question_idx": 61, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 1 happen before Step 10?", "why_question": "Why must Step 1 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 1 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 10 because the oven needs to be preheated before baking the cupcakes.\"\n}"}
{"plan_idx": 62, "title": "brown sugar shortbread", "question_idx": 62, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 8 happen before Step 10?", "why_question": "Why must Step 8 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 8 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 8 must happen before Step 10 because the shortbread needs to be cut into strips before baking.\" \n}"}
{"plan_idx": 63, "title": "balsamic-and-mozzarella-chicken", "question_idx": 63, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chicken needs to be in the dish or bag before the vinaigrette can be poured over it.\"\n}"}
{"plan_idx": 64, "title": "almond and apple cake", "question_idx": 64, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 13], "binary_question": "Must Step 8 happen before Step 14?", "why_question": "Why must Step 8 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cake needs to be baked before it can be served.\"\n}"}
{"plan_idx": 65, "title": "no-sugar-rock-cakes", "question_idx": 65, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 4 happen before Step 7?", "why_question": "Why must Step 4 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 4 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the dough needs to be formed before placing it on the baking tray.\"\n}"}
{"plan_idx": 66, "title": "chocolate-pancake-batter", "question_idx": 66, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 10 happen before Step 11?", "why_question": "Why must Step 10 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 10 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen before Step 10, as the pancakes can be stacked to keep warm while the remaining batter is being cooked.\"\n}"}
{"plan_idx": 67, "title": "chicken-prawn-and-rice-soup", "question_idx": 67, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 1 happen before Step 8?", "why_question": "Why must Step 1 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 1 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 8 because the mixture prepared in Step 1 needs to be added to the soup before the salt and sherry are added in Step 7 and Step 8.\"\n}"}
{"plan_idx": 68, "title": "brown sugar shortbread", "question_idx": 68, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 6 happen before Step 10?", "why_question": "Why must Step 6 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 6 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 10 because the dough needs to be kneaded and rolled before baking.\" \n}"}
{"plan_idx": 69, "title": "lightly spiced tomato and red lentil soup", "question_idx": 69, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 6 happen before Step 9?", "why_question": "Why must Step 6 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 6 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 9 because the soup needs to be simmered until the lentils and vegetables are very soft before blending.\" \n}"}
{"plan_idx": 70, "title": "vegetable-terrine", "question_idx": 70, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 9 because the chopped sorrel needs to be added to the cream mixture before pouring it into the mould.\"\n}"}
{"plan_idx": 71, "title": "chicken and vegetable pie", "question_idx": 71, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 9 happen before Step 12?", "why_question": "Why must Step 9 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 9 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The hot liquid mixture needs to be poured over the chicken mixture before covering with the top pastry.\"\n}"}
{"plan_idx": 72, "title": "creamy-chayote-squash-soup", "question_idx": 72, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 5 happen before Step 9?", "why_question": "Why must Step 5 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 5 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 9 because the soup needs to be simmered and then pureed before being poured into bowls and garnished.\" \n}"}
{"plan_idx": 73, "title": "chicken and vegetable pie", "question_idx": 73, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 14], "binary_question": "Must Step 1 happen before Step 15?", "why_question": "Why must Step 1 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 1 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 15 because the oven needs to be preheated before baking the pie.\"\n}"}
{"plan_idx": 74, "title": "chocolate-pancake-batter", "question_idx": 74, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 4 because the batter needs to rest for best results.\"\n}"}
{"plan_idx": 75, "title": "almond and apple cake", "question_idx": 75, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 11 happen before Step 12?", "why_question": "Why must Step 11 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 11 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The mixture needs to be spooned into the tin before baking in the oven.\"\n}"}
{"plan_idx": 76, "title": "chocolate-chocolate-cake", "question_idx": 76, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 17], "binary_question": "Must Step 4 happen before Step 18?", "why_question": "Why must Step 4 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 4 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chocolate mixture needs to be smooth and cooled before baking the cake.\"\n}"}
{"plan_idx": 77, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 77, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 8 because the salad needs to be arranged with grapefruit segments and smoked salmon before the dressing is poured over.\" \n}"}
{"plan_idx": 78, "title": "tomato and basil salad", "question_idx": 78, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 1 happen before Step 5?", "why_question": "Why must Step 1 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 1 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 5 because the serving plate needs to be prepared before the salad is assembled and covered.\" \n}"}
{"plan_idx": 79, "title": "chicken-prawn-and-rice-soup", "question_idx": 79, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 3 happen before Step 12?", "why_question": "Why must Step 3 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 3 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The prawns and chicken mixture needs to be cooked before adding it to the soup in Step 5.\"\n}"}
{"plan_idx": 80, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 80, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 15], "binary_question": "Must Step 3 happen before Step 16?", "why_question": "Why must Step 3 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 3 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 16 because the lemon zest is incorporated into the dough in Step 4, and the lemon butter is used in Step 15.\"\n}"}
{"plan_idx": 81, "title": "spiced-pumpkin-teabread", "question_idx": 81, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 5 happen before Step 9?", "why_question": "Why must Step 5 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 5 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The pumpkin mixture needs to be added and mixed well before transferring the mixture into the tin.\"\n}"}
{"plan_idx": 82, "title": "fusilli-and-meatballs", "question_idx": 82, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [13, 15], "binary_question": "Must Step 14 happen before Step 16?", "why_question": "Why must Step 14 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be browned before being added to the tomato sauce to ensure they are fully cooked.\"\n}"}
{"plan_idx": 83, "title": "green-tofu-curry", "question_idx": 83, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 8 because the tofu needs to be fried before being seasoned with salt and the coconut milk needs to be brought to a boil before mixing in the green curry paste.\"\n}"}
{"plan_idx": 84, "title": "slow cooker butter chicken", "question_idx": 84, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 7 happen before Step 8?", "why_question": "Why must Step 7 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 7 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 8 because the chicken needs to cook for the specified time before removing the cardamom pods and serving.\"\n}"}
{"plan_idx": 85, "title": "fusilli-and-meatballs", "question_idx": 85, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [14, 20], "binary_question": "Must Step 15 happen before Step 21?", "why_question": "Why must Step 15 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 15 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be cooked before being added to the sauce and served with the pasta.\"\n}"}
{"plan_idx": 86, "title": "spiced-pumpkin-teabread", "question_idx": 86, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 5 happen before Step 14?", "why_question": "Why must Step 5 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 5 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 14 because the teabread needs to be prepared and baked before being served.\"\n}"}
{"plan_idx": 87, "title": "spiced butternut squash soup", "question_idx": 87, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 15], "binary_question": "Must Step 4 happen before Step 16?", "why_question": "Why must Step 4 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 4 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 16 because the squash needs to be baked and then added to the soup before heating through.\"\n}"}
{"plan_idx": 88, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 88, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 1 happen before Step 6?", "why_question": "Why must Step 1 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 1 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 6 because the onions need to be softened before adding the other ingredients.\"\n}"}
{"plan_idx": 89, "title": "curried bbq mussels", "question_idx": 89, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 5 happen before Step 10?", "why_question": "Why must Step 5 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 5 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 10 because the curry mixture needs to be added to the mussels before they are cooked, and the mussels need to be checked for opening after cooking.\" \n}"}
{"plan_idx": 90, "title": "spiced-guava-cake", "question_idx": 90, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 7 happen before Step 9?", "why_question": "Why must Step 7 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 7 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 7 must happen before Step 9 because the batter needs to be prepared and poured into the tin before baking.\"\n}"}
{"plan_idx": 91, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 91, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 2 happen before Step 8?", "why_question": "Why must Step 2 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 2 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 8 because the grapefruit juice from the bowl is needed to mix with cracked peppercorns in Step 7, and the juice is obtained in Step 2.\"\n}"}
{"plan_idx": 92, "title": "tangy-gammon-in-cider", "question_idx": 92, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 2 happen before Step 7?", "why_question": "Why must Step 2 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 2 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen before Step 2 as Step 2 is not directly dependent on Step 7.\"\n}"}
{"plan_idx": 93, "title": "almond and apple cake", "question_idx": 93, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 5 happen before Step 14?", "why_question": "Why must Step 5 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 5 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cake needs to be baked before it can be served, so Step 5 must happen before Step 14.\"\n}"}
{"plan_idx": 94, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 94, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen before or after Step 6, as brushing with olive oil and sprinkling almonds are independent actions.\"\n}"}
{"plan_idx": 95, "title": "tortellini-fritto-with-almond-butter", "question_idx": 95, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 7 because the tortellini needs to be fried before serving.\"\n}"}
{"plan_idx": 96, "title": "spiced-pumpkin-teabread", "question_idx": 96, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 9 happen before Step 10?", "why_question": "Why must Step 9 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 9 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 10 because the mixture needs to be placed in the tin before sprinkling with pumpkin seeds and baking.\"\n}"}
{"plan_idx": 97, "title": "slow cooker butter chicken", "question_idx": 97, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 5 because the ingredients need to be combined and mixed thoroughly before transferring to the slow cooker.\"\n}"}
{"plan_idx": 98, "title": "slow cooker butter chicken", "question_idx": 98, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 1 happen before Step 4?", "why_question": "Why must Step 1 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 1 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to cook the chicken, onion, and garlic before adding the other ingredients in Step 4.\"\n}"}
{"plan_idx": 99, "title": "lightly spiced tomato and red lentil soup", "question_idx": 99, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 5 because the vegetables need to be softened before adding the lentils, stock, and other ingredients.\"\n}"}
{"plan_idx": 100, "title": "spanish-rabbit-stew", "question_idx": 100, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 4 happen before Step 10?", "why_question": "Why must Step 4 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 4 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen independently of Step 4 as it is not dependent on the timing or completion of Step 4.\"\n}"}
{"plan_idx": 101, "title": "chocolate-chocolate-cake", "question_idx": 101, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 16], "binary_question": "Must Step 9 happen before Step 17?", "why_question": "Why must Step 9 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 9 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 17 because the mixture needs to be poured into the cake tin before baking.\"\n}"}
{"plan_idx": 102, "title": "spiced-pumpkin-teabread", "question_idx": 102, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 2 happen before Step 9?", "why_question": "Why must Step 2 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 2 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The loaf tin needs to be prepared before the mixture is added to it.\"\n}"}
{"plan_idx": 103, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 103, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 5 because the mushrooms need to release their juices before adding the other ingredients for the sauce.\"\n}"}
{"plan_idx": 104, "title": "strawberry-tiramisu-trifle", "question_idx": 104, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 7 because the strawberries need to be spread over the sponge fingers before adding the grated chocolate and custard mixture.\"\n}"}
{"plan_idx": 105, "title": "spiced butternut squash soup", "question_idx": 105, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 15], "binary_question": "Must Step 3 happen before Step 16?", "why_question": "Why must Step 3 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 3 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 16 because the squash needs to be baked and prepared before it can be added to the soup.\" \n}"}
{"plan_idx": 106, "title": "chicken and vegetable pie", "question_idx": 106, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 14], "binary_question": "Must Step 2 happen before Step 15?", "why_question": "Why must Step 2 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 2 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 15 because the chicken and vegetables need to be cooked before being placed in the pie and baked.\"\n}"}
{"plan_idx": 107, "title": "shellabina-s-corned-beef-hash", "question_idx": 107, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 does not need to happen before Step 6 because the stew will thicken up after adding gravy granules and stirring, not necessarily after simmering for 20 minutes.\"\n}"}
{"plan_idx": 108, "title": "chicken and vegetable pie", "question_idx": 108, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 4 happen before Step 14?", "why_question": "Why must Step 4 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 4 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chicken mixture needs to be prepared and placed in the pie dish before the pastry is added and the pie is baked.\"\n}"}
{"plan_idx": 109, "title": "spiced-pumpkin-teabread", "question_idx": 109, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 9 happen before Step 11?", "why_question": "Why must Step 9 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 9 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 11 because the mixture needs to be baked in the tin before it can be allowed to cool and turned out onto a wire rack.\"\n}"}
{"plan_idx": 110, "title": "almond and apple cake", "question_idx": 110, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 9 because the flour and milk need to be added gradually and in two parts after the butter and sugar have been beaten together.\"\n}"}
{"plan_idx": 111, "title": "chocolate-chocolate-cake", "question_idx": 111, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 21], "binary_question": "Must Step 4 happen before Step 22?", "why_question": "Why must Step 4 happen before Step 22?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 4 happen before Step 22?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 22 can happen after Step 4, as it is not dependent on the completion of Step 4.\"\n}"}
{"plan_idx": 112, "title": "strawberries-in-pimm-s", "question_idx": 112, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 2 must happen before Step 6 because the strawberries need to be coated with sugar before garnishing with mint leaves.\"\n}"}
{"plan_idx": 113, "title": "chocolate-chocolate-cake", "question_idx": 113, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 20], "binary_question": "Must Step 3 happen before Step 21?", "why_question": "Why must Step 3 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 3 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 21 can happen before Step 3 as it is not dependent on the completion of Step 3.\"\n}"}
{"plan_idx": 114, "title": "very-vanilla-ry-cheesecake", "question_idx": 114, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 2 happen before Step 11?", "why_question": "Why must Step 2 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 2 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 must happen before Step 2 because the cheesecake needs to be baked before the biscuit base is prepared.\"\n}"}
{"plan_idx": 115, "title": "brown sugar shortbread", "question_idx": 115, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 3 happen before Step 9?", "why_question": "Why must Step 3 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 3 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 9 because the dough needs to be prepared before it can be placed on the baking trays and baked.\"\n}"}
{"plan_idx": 116, "title": "very-vanilla-ry-cheesecake", "question_idx": 116, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 6 happen before Step 13?", "why_question": "Why must Step 6 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 6 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cheesecake needs to be refrigerated after being mixed and baked before it can be served.\"\n}"}
{"plan_idx": 117, "title": "chicken and vegetable pie", "question_idx": 117, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 13], "binary_question": "Must Step 7 happen before Step 14?", "why_question": "Why must Step 7 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 7 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The hot liquid mixture needs to be poured over the chicken mixture before baking in the oven.\"\n}"}
{"plan_idx": 118, "title": "spiced-pumpkin-teabread", "question_idx": 118, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 7 because the flour and allspice need to be sifted and combined before rubbing in the butter.\"\n}"}
{"plan_idx": 119, "title": "no-sugar-rock-cakes", "question_idx": 119, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The dough needs to be formed before baking it in the oven.\"\n}"}
{"plan_idx": 120, "title": "spiced-pumpkin-teabread", "question_idx": 120, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 13], "binary_question": "Must Step 3 happen before Step 14?", "why_question": "Why must Step 3 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 3 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The pumpkin flesh needs to be cooked and mashed before the teabread can be made and served.\"\n}"}
{"plan_idx": 121, "title": "chocolate-chocolate-cake", "question_idx": 121, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 8 because the butter and margarine need to be creamy before adding the sugar and egg yolks.\"\n}"}
{"plan_idx": 122, "title": "vegetable-terrine", "question_idx": 122, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 4 happen before Step 11?", "why_question": "Why must Step 4 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 4 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 11 because the chopped sorrel from Step 4 needs to be arranged with the vegetables in Step 11.\"\n}"}
{"plan_idx": 123, "title": "chicken-prawn-and-rice-soup", "question_idx": 123, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 6 because the prawns and chicken mixture needs to be cooked before being added to the pot with the stock and other ingredients.\"\n}"}
{"plan_idx": 124, "title": "very-vanilla-ry-cheesecake", "question_idx": 124, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 3 happen before Step 12?", "why_question": "Why must Step 3 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 3 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The vanilla seeds need to be mixed with the biscuit crumbs before the cheesecake is baked.\"\n}"}
{"plan_idx": 125, "title": "fusilli-and-meatballs", "question_idx": 125, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 20], "binary_question": "Must Step 13 happen before Step 21?", "why_question": "Why must Step 13 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be cooked and added to the sauce before serving with the pasta.\"\n}"}
{"plan_idx": 126, "title": "curried bbq mussels", "question_idx": 126, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 2 happen before Step 10?", "why_question": "Why must Step 2 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 2 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 does not need to happen before Step 10 because Step 10 involves discarding any mussels that do not open, which is independent of the curry mixture from Step 2.\"\n}"}
{"plan_idx": 127, "title": "banana-split-cake", "question_idx": 127, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 4 because the mixture needs to be pressed into the tin before baking.\"\n}"}
{"plan_idx": 128, "title": "balsamic-and-mozzarella-chicken", "question_idx": 128, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 1 happen before Step 8?", "why_question": "Why must Step 1 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 1 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 8 because the chicken needs to be marinated before it is cooked and assembled with the mozzarella, basil, and tomato.\"\n}"}
{"plan_idx": 129, "title": "tortellini-fritto-with-almond-butter", "question_idx": 129, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 3 because the tortellini needs to be boiled before it can be fried.\"\n}"}
{"plan_idx": 130, "title": "balsamic-and-mozzarella-chicken", "question_idx": 130, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen before Step 3 as they are independent of each other.\"\n}"}
{"plan_idx": 131, "title": "strawberry-tiramisu-trifle", "question_idx": 131, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 6 happen before Step 10?", "why_question": "Why must Step 6 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 6 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 10 because the strawberries need to be spread over the sponge fingers before the trifle is covered and refrigerated.\"\n}"}
{"plan_idx": 132, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 132, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen before Step 5, as the almonds can be sprinkled on top after the rolls are grilled.\" \n}"}
{"plan_idx": 133, "title": "vegetable-terrine", "question_idx": 133, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cream and yogurt need to be brought to a boil before adding the chopped sorrel and gelatin.\"\n}"}
{"plan_idx": 134, "title": "brown sugar shortbread", "question_idx": 134, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 5 happen before Step 10?", "why_question": "Why must Step 5 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 5 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 10 because the dough needs to be rolled and cut before baking.\"\n}"}
{"plan_idx": 135, "title": "vegetable-terrine", "question_idx": 135, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 5 happen before Step 12?", "why_question": "Why must Step 5 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cream mixture needs to be poured before arranging the vegetables on top of it.\"\n}"}
{"plan_idx": 136, "title": "fusilli-and-meatballs", "question_idx": 136, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 8 happen before Step 10?", "why_question": "Why must Step 8 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 8 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"The steps can happen simultaneously as they are independent of each other.\"\n}"}
{"plan_idx": 137, "title": "lightly spiced tomato and red lentil soup", "question_idx": 137, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 11 happen before Step 12?", "why_question": "Why must Step 11 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 11 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Seasoning to taste should happen before serving the soup.\"\n}"}
{"plan_idx": 138, "title": "tangy-gammon-in-cider", "question_idx": 138, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 3 happen before Step 8?", "why_question": "Why must Step 3 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 3 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 can happen before Step 3 as Step 3 involves preparing the ingredients, while Step 8 involves cooking the dish.\"\n}"}
{"plan_idx": 139, "title": "vegetable-terrine", "question_idx": 139, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 4 happen before Step 14?", "why_question": "Why must Step 4 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 4 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 14 because the sorrel needs to be cooked and set aside before the terrine is released from the mould.\"\n}"}
{"plan_idx": 140, "title": "chocolate-chocolate-cake", "question_idx": 140, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 16], "binary_question": "Must Step 13 happen before Step 17?", "why_question": "Why must Step 13 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 13 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, Step 13 does not need to happen before Step 17 because Step 13 involves folding the egg white mixture into the chocolate mixture, while Step 17 involves baking the cake.\" \n}"}
{"plan_idx": 141, "title": "spiced-pumpkin-teabread", "question_idx": 141, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 4 happen before Step 12?", "why_question": "Why must Step 4 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 4 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 12 because the pumpkin mixture needs to be prepared and added to the tin before baking and cooling the teabread.\"\n}"}
{"plan_idx": 142, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 142, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 1 happen before Step 7?", "why_question": "Why must Step 1 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 1 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 7 because the grapefruits need to be prepared and the juice collected before mixing it with peppercorns for the salad dressing.\"\n}"}
{"plan_idx": 143, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 143, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 15], "binary_question": "Must Step 12 happen before Step 16?", "why_question": "Why must Step 12 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 12 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 16 can happen before Step 12 because the whipped cream can be prepared and used to assemble the shortcakes before the lemon butter is spread on the cake bottoms.\"\n}"}
{"plan_idx": 144, "title": "one-pot irish stew", "question_idx": 144, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 4 happen before Step 6?", "why_question": "Why must Step 4 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 4 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can happen before or after Step 4, as seasoning can be added at any point during the cooking process.\"\n}"}
{"plan_idx": 145, "title": "chocolate-chocolate-cake", "question_idx": 145, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 21], "binary_question": "Must Step 5 happen before Step 22?", "why_question": "Why must Step 5 happen before Step 22?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 5 happen before Step 22?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, step 22 can happen after step 5 as it is not dependent on the cooling of the chocolate mixture.\"\n}"}
{"plan_idx": 146, "title": "simple-basic-cupcakes", "question_idx": 146, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 5 happen before Step 9?", "why_question": "Why must Step 5 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 5 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 5 must happen before Step 9 because the cupcakes need to be fully baked before allowing them to cool.\"\n}"}
{"plan_idx": 147, "title": "spiced-pumpkin-teabread", "question_idx": 147, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 6 happen before Step 11?", "why_question": "Why must Step 6 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 6 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The mixture needs to be prepared and put into the tin before baking.\"\n}"}
{"plan_idx": 148, "title": "chocolate-chocolate-cake", "question_idx": 148, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 12], "binary_question": "Must Step 5 happen before Step 13?", "why_question": "Why must Step 5 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 5 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chocolate mixture needs to be cooled before folding in the egg white mixture.\"\n}"}
{"plan_idx": 149, "title": "banana-split-cake", "question_idx": 149, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The filling needs to be spread over the cooled base before adding the bananas and pineapple.\"\n}"}
{"plan_idx": 150, "title": "chicken and vegetable pie", "question_idx": 150, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 15], "binary_question": "Must Step 4 happen before Step 16?", "why_question": "Why must Step 4 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 4 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 16 because the chicken mixture needs to be prepared and set aside before it can be placed in the pie dish and baked.\"\n}"}
{"plan_idx": 151, "title": "chicken and vegetable pie", "question_idx": 151, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 needs to happen before Step 8 because the onion needs to be cooked in butter before the flour, salt, pepper, and celery seed are added to it.\"\n}"}
{"plan_idx": 152, "title": "tangy-gammon-in-cider", "question_idx": 152, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tomatoes need to be softened before removing the skins in step 4.\"\n}"}
{"plan_idx": 153, "title": "cloud-bread", "question_idx": 153, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 8 because the egg whites need to be beaten to stiff peaks before being folded into the cream cheese and egg yolk mixture.\"\n}"}
{"plan_idx": 154, "title": "one-pot irish stew", "question_idx": 154, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 2 because it involves bringing the lamb to a boil and skimming off any fat, which is necessary before simmering for 30 minutes.\"\n}"}
{"plan_idx": 155, "title": "tangy-gammon-in-cider", "question_idx": 155, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 5 because the onions need to be chopped and prepared before being added to the casserole dish with the tomatoes and apples.\"\n}"}
{"plan_idx": 156, "title": "fusilli-and-meatballs", "question_idx": 156, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 14], "binary_question": "Must Step 3 happen before Step 15?", "why_question": "Why must Step 3 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 3 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The onion mixture from Step 3 is used to make the meatballs in Step 12, so Step 3 must happen before Step 15.\"\n}"}
{"plan_idx": 157, "title": "butternut-squash-pastry-for-pies", "question_idx": 157, "steps": ["Place the flour, egg and squash into the container of a food processor.", "Pulse until mixed into a doughy ball.", "You may need to add a little extra flour.", "Divide into two equal parts.", "Use in a pie or pastie recipe."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: butternut-squash-pastry-for-pies\n\nProcedure:\n1. Place the flour, egg and squash into the container of a food processor.\n2. Pulse until mixed into a doughy ball.\n3. You may need to add a little extra flour.\n4. Divide into two equal parts.\n5. Use in a pie or pastie recipe.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not need to happen before Step 5 because adding extra flour is not a requirement for using the dough in a pie or pastie recipe.\"\n}"}
{"plan_idx": 158, "title": "white bread", "question_idx": 158, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the yeast needs to proof and become foamy before adding the flour.\"\n}"}
{"plan_idx": 159, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 159, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 7 happen before Step 10?", "why_question": "Why must Step 7 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 7 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 does not need to happen before Step 10, as the order of serving the dish and mixing in the peppers and tuna can be flexible.\"\n}"}
{"plan_idx": 160, "title": "no-sugar-rock-cakes", "question_idx": 160, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 7 happen before Step 9?", "why_question": "Why must Step 7 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 7 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 9 because the rock cakes need to be baked before they can be removed and placed on a cooling tray.\"\n}"}
{"plan_idx": 161, "title": "tomato and basil salad", "question_idx": 161, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 should happen before Step 4 because the vinegar and oil need to be drizzled over the salted tomatoes and basil leaves.\"\n}"}
{"plan_idx": 162, "title": "fusilli-and-meatballs", "question_idx": 162, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [13, 20], "binary_question": "Must Step 14 happen before Step 21?", "why_question": "Why must Step 14 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 21 can happen before Step 14 as the pasta can be cooked and tossed with the sauce while the meatballs are still cooking in the sauce.\"\n}"}
{"plan_idx": 163, "title": "spiced-pumpkin-teabread", "question_idx": 163, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 8 happen before Step 12?", "why_question": "Why must Step 8 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 8 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The loaf needs to cool in the tin for 10 minutes before being turned out onto a wire rack.\"\n}"}
{"plan_idx": 164, "title": "no-sugar-rock-cakes", "question_idx": 164, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 7 because the dough needs to be placed on the baking tray before spacing them out.\"\n}"}
{"plan_idx": 165, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 165, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 7 because the dough needs to be formed before it can be divided and shaped into circles.\"\n}"}
{"plan_idx": 166, "title": "lightly spiced tomato and red lentil soup", "question_idx": 166, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 4 happen before Step 12?", "why_question": "Why must Step 4 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 4 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 12 because the spices need to be cooked and incorporated into the soup before serving.\"\n}"}
{"plan_idx": 167, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 167, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 7 happen before Step 10?", "why_question": "Why must Step 7 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 7 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 10 because the shortcakes need to cool for 15 minutes before assembling.\" \n}"}
{"plan_idx": 168, "title": "brown sugar shortbread", "question_idx": 168, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Kneading the dough before rolling it out ensures that the dough is well combined and has the right texture for rolling.\" \n}"}
{"plan_idx": 169, "title": "spiced-pumpkin-teabread", "question_idx": 169, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 11], "binary_question": "Must Step 10 happen before Step 12?", "why_question": "Why must Step 10 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 10 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The teabread needs to be baked before it can be allowed to cool in the tin.\"\n}"}
{"plan_idx": 170, "title": "banana-split-cake", "question_idx": 170, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 2 happen before Step 11?", "why_question": "Why must Step 2 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 2 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 11 because the base needs to be baked and cooled before adding the other ingredients.\"\n}"}
{"plan_idx": 171, "title": "lightly spiced tomato and red lentil soup", "question_idx": 171, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 1 happen before Step 9?", "why_question": "Why must Step 1 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 1 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 9 because the soup needs to be blended after it has been cooked and simmered.\"\n}"}
{"plan_idx": 172, "title": "scone-pastry", "question_idx": 172, "steps": ["Sift the flour, baking powder and salt into a bowl.", "Add the butter and rub in until the mixture resembles fine crumbs.", "Make a well in the centre and add the milk.", "Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.", "Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: scone-pastry\n\nProcedure:\n1. Sift the flour, baking powder and salt into a bowl.\n2. Add the butter and rub in until the mixture resembles fine crumbs.\n3. Make a well in the centre and add the milk.\n4. Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.\n5. Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required.\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 2 because the ingredients need to be combined and prepared before the butter is added and rubbed in.\"\n}"}
{"plan_idx": 173, "title": "spiced-pumpkin-teabread", "question_idx": 173, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 3 happen before Step 8?", "why_question": "Why must Step 3 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 3 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The pumpkin mixture needs to be prepared before it can be added to the flour mixture in Step 8.\"\n}"}
{"plan_idx": 174, "title": "chocolate-chocolate-cake", "question_idx": 174, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 7 happen before Step 10?", "why_question": "Why must Step 7 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 7 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The sugar needs to be beaten in before adding the cooled chocolate to the mix.\"\n}"}
{"plan_idx": 175, "title": "slow cooker butter chicken", "question_idx": 175, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 7 because the chicken and onion need to be cooked and softened before being transferred to the slow cooker for further cooking.\"\n}"}
{"plan_idx": 176, "title": "tangy-gammon-in-cider", "question_idx": 176, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 must happen before Step 6 because the cider needs to be poured over the steaks before they are wrapped and secured with a skewer or spaghetti.\"\n}"}
{"plan_idx": 177, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 177, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 3 because the ingredients need to be mixed together before stirring until creamy.\"\n}"}
{"plan_idx": 178, "title": "spicy-tomato-anchovy-pasta", "question_idx": 178, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 5 happen before Step 10?", "why_question": "Why must Step 5 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 5 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not need to happen before Step 10 because the pasta can be cooked and ready to serve while the anchovy mixture is being prepared.\"\n}"}
{"plan_idx": 179, "title": "spiced butternut squash soup", "question_idx": 179, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 9 happen before Step 11?", "why_question": "Why must Step 9 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 9 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The potatoes need to cook in the chicken stock before adding the squash.\"\n}"}
{"plan_idx": 180, "title": "chocolate-chocolate-cake", "question_idx": 180, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 8 happen before Step 10?", "why_question": "Why must Step 8 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The egg yolks need to be gradually beaten in before adding the cooled chocolate to the mix.\"\n}"}
{"plan_idx": 181, "title": "slow cooker butter chicken", "question_idx": 181, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 7 because the ingredients need to be combined and cooked in the slow cooker for the specified time to achieve the desired flavor and consistency.\"\n}"}
{"plan_idx": 182, "title": "vegetable-terrine", "question_idx": 182, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 13], "binary_question": "Must Step 11 happen before Step 14?", "why_question": "Why must Step 11 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 11 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen before Step 14 because the arrangement of the vegetables needs to be done before the terrine is refrigerated and set.\" \n}"}
{"plan_idx": 183, "title": "spiced-pumpkin-teabread", "question_idx": 183, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 1 happen before Step 12?", "why_question": "Why must Step 1 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 1 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 12 because the loaf needs to cool in the tin for 10 minutes before being turned out onto a wire rack.\"\n}"}
{"plan_idx": 184, "title": "spiced-pumpkin-teabread", "question_idx": 184, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 7 happen before Step 9?", "why_question": "Why must Step 7 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 7 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The pumpkin mixture needs to be added and mixed before the mixture is put into the tin and smoothed.\" \n}"}
{"plan_idx": 185, "title": "strawberries-in-pimm-s", "question_idx": 185, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 1 happen before Step 6?", "why_question": "Why must Step 1 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 1 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 1 must happen before Step 6 because the strawberries need to be prepared before they can be garnished with mint leaves.\"\n}"}
{"plan_idx": 186, "title": "chocolate-pancake-batter", "question_idx": 186, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 5 happen before Step 9?", "why_question": "Why must Step 5 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 5 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 9 because the frying pan needs to be heated before the pancake is cooked on both sides.\"\n}"}
{"plan_idx": 187, "title": "spiced-pumpkin-teabread", "question_idx": 187, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 13], "binary_question": "Must Step 1 happen before Step 14?", "why_question": "Why must Step 1 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 1 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to preheat the oven before baking the teabread in Step 11.\"\n}"}
{"plan_idx": 188, "title": "very-vanilla-ry-cheesecake", "question_idx": 188, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 2 happen before Step 9?", "why_question": "Why must Step 2 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 2 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The biscuit base needs to be prepared before pouring the cheesecake mixture into the tin.\"\n}"}
{"plan_idx": 189, "title": "spiced butternut squash soup", "question_idx": 189, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 11 happen before Step 12?", "why_question": "Why must Step 11 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be cooked before it can be mashed with the potatoes in Step 12.\"\n}"}
{"plan_idx": 190, "title": "strawberry-tiramisu-trifle", "question_idx": 190, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 8 because it is the foundation for the subsequent layers and provides the base for the trifle.\"\n}"}
{"plan_idx": 191, "title": "sardine spread", "question_idx": 191, "steps": ["Place the sardines in a bowl and roughly mash with a fork.", "Add in all of the remaining ingredients and stir well.", "Enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: sardine spread\n\nProcedure:\n1. Place the sardines in a bowl and roughly mash with a fork.\n2. Add in all of the remaining ingredients and stir well.\n3. Enjoy!\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 2 because the sardines need to be mashed before adding the remaining ingredients.\"\n}"}
{"plan_idx": 192, "title": "chicken-prawn-and-rice-soup", "question_idx": 192, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The prawns and chicken need to be mixed together before they can be added to the hot oil in Step 3.\"\n}"}
{"plan_idx": 193, "title": "fusilli-and-meatballs", "question_idx": 193, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 19], "binary_question": "Must Step 3 happen before Step 20?", "why_question": "Why must Step 3 happen before Step 20?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 3 happen before Step 20?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 20 because the meatballs need to be prepared before the pasta is cooked and tossed with the sauce.\"\n}"}
{"plan_idx": 194, "title": "black-rice-pudding", "question_idx": 194, "steps": ["Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.", "Bring to the boil over high heat, stirring frequently.", "Reduce heat to medium-low.", "Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.", "Stir in coconut cream and vanilla extract.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 1 happen before Step 5?", "why_question": "Why must Step 1 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: black-rice-pudding\n\nProcedure:\n1. Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.\n2. Bring to the boil over high heat, stirring frequently.\n3. Reduce heat to medium-low.\n4. Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.\n5. Stir in coconut cream and vanilla extract.\n6. Serve warm.\n\n\n1. Must Step 1 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 5 because the rice needs to be cooked and tender before adding the coconut cream and vanilla extract.\"\n}"}
{"plan_idx": 195, "title": "white bread", "question_idx": 195, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 1 happen before Step 7?", "why_question": "Why must Step 1 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 1 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 7 because the dough needs to rise for 1 hour after being covered with a damp cloth in Step 7.\"\n}"}
{"plan_idx": 196, "title": "almond and apple cake", "question_idx": 196, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 6 happen before Step 9?", "why_question": "Why must Step 6 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 6 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The ground almonds need to be stirred in before adding the remaining flour and milk.\"\n}"}
{"plan_idx": 197, "title": "chocolate-pancake-batter", "question_idx": 197, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 3 happen before Step 10?", "why_question": "Why must Step 3 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 3 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 10 because Step 3 involves preparing the pancake batter, which is necessary before cooking the pancakes in Step 10.\"\n}"}
{"plan_idx": 198, "title": "balsamic-and-mozzarella-chicken", "question_idx": 198, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the chicken needs to be cooked before it is arranged on the serving platter.\"\n}"}
{"plan_idx": 199, "title": "chicken and vegetable pie", "question_idx": 199, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 7 happen before Step 9?", "why_question": "Why must Step 7 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 7 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, step 7 must happen before step 9 because the hot liquid mixture needs to be prepared before it can be simmered and thickened.\" \n}"}
{"plan_idx": 200, "title": "chocolate-chocolate-cake", "question_idx": 200, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 21], "binary_question": "Must Step 8 happen before Step 22?", "why_question": "Why must Step 8 happen before Step 22?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen before Step 22?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 22 because the egg yolks need to be gradually beaten in before the cake is cooled and decorated.\"\n}"}
{"plan_idx": 201, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 201, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 6 because the dough needs to be kneaded before it can be divided.\"\n}"}
{"plan_idx": 202, "title": "white bread", "question_idx": 202, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 7 happen before Step 12?", "why_question": "Why must Step 7 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 7 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 7 must happen before Step 12 because the dough needs to rise before it can be baked.\"\n}"}
{"plan_idx": 203, "title": "spiced butternut squash soup", "question_idx": 203, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [13, 14], "binary_question": "Must Step 14 happen before Step 15?", "why_question": "Why must Step 14 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 14 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 can happen before Step 14 because seasoning the soup and adding the sherry, cream, and milk can be done in any order.\"\n}"}
{"plan_idx": 204, "title": "chicken-prawn-and-rice-soup", "question_idx": 204, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 7 because the ingredients need to be brought to a boil before adding salt and sherry.\"\n}"}
{"plan_idx": 205, "title": "spiced butternut squash soup", "question_idx": 205, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 15], "binary_question": "Must Step 11 happen before Step 16?", "why_question": "Why must Step 11 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The soup needs to be cooked before it is seasoned and heated through.\"\n}"}
{"plan_idx": 206, "title": "cranachan", "question_idx": 206, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 8 because the whipped cream with oats needs to be prepared before spooning into serving bowls and topping with fresh berries.\"\n}"}
{"plan_idx": 207, "title": "jam-drop-biscuits", "question_idx": 207, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the hollow needs to be made in the biscuit dough before filling it with jam and baking it.\"\n}"}
{"plan_idx": 208, "title": "cranachan", "question_idx": 208, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 5 happen before Step 10?", "why_question": "Why must Step 5 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 5 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 10 because the oats need to be cooled before serving, and garnishing with a mint leaf is the final step.\"\n}"}
{"plan_idx": 209, "title": "chocolate-chocolate-cake", "question_idx": 209, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [14, 16], "binary_question": "Must Step 15 happen before Step 17?", "why_question": "Why must Step 15 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 15 must happen before Step 17 because the cake tin needs to be prepared before pouring the mixture into it for baking.\"\n}"}
{"plan_idx": 210, "title": "simple-basic-cupcakes", "question_idx": 210, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 7 happen before Step 10?", "why_question": "Why must Step 7 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 7 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 10 because the cupcakes need to be baked before they can be decorated.\"\n}"}
{"plan_idx": 211, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 211, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 7 because the cheese mix needs to be prepared before it can be sprinkled with almonds or rolled in almonds.\"\n}"}
{"plan_idx": 212, "title": "white bread", "question_idx": 212, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 7 happen before Step 8?", "why_question": "Why must Step 7 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 7 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 8 because the dough needs to rise before it can be punched down.\"\n}"}
{"plan_idx": 213, "title": "jam-drop-biscuits", "question_idx": 213, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the dough needs to be chilled before forming into balls and filling with jam before baking.\"\n}"}
{"plan_idx": 214, "title": "lightly spiced tomato and red lentil soup", "question_idx": 214, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 9 happen before Step 11?", "why_question": "Why must Step 9 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 9 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Blending the soup in step 9 is necessary to achieve the desired consistency before reheating in step 11.\"\n}"}
{"plan_idx": 215, "title": "spiced butternut squash soup", "question_idx": 215, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 16], "binary_question": "Must Step 2 happen before Step 17?", "why_question": "Why must Step 2 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 2 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 does not need to happen before Step 17 because Step 2 is related to preparing the squash, while Step 17 is related to serving the soup.\"\n}"}
{"plan_idx": 216, "title": "very-vanilla-ry-cheesecake", "question_idx": 216, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 2 happen before Step 12?", "why_question": "Why must Step 2 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 2 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 12 because the crumbs need to be prepared and placed in the tin before the cheesecake is baked and cooled.\"\n}"}
{"plan_idx": 217, "title": "chocolate-chocolate-cake", "question_idx": 217, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 15], "binary_question": "Must Step 8 happen before Step 16?", "why_question": "Why must Step 8 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The egg yolks need to be gradually beaten in before pouring the mixture into the cake tin.\"\n}"}
{"plan_idx": 218, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 218, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 9 because the spinach rolls need to be blanched before grilling and then allowed to cool before serving.\"\n}"}
{"plan_idx": 219, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 219, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 14], "binary_question": "Must Step 7 happen before Step 15?", "why_question": "Why must Step 7 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 7 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 15 because the dough needs to be prepared and baked before assembling the shortcakes.\"\n}"}
{"plan_idx": 220, "title": "chocolate-chocolate-cake", "question_idx": 220, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 6 happen before Step 13?", "why_question": "Why must Step 6 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 must happen before Step 6 because the egg whites need to be folded into the chocolate mixture before pouring it into the cake tin.\"\n}"}
{"plan_idx": 221, "title": "chicken-prawn-and-rice-soup", "question_idx": 221, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 5 happen before Step 12?", "why_question": "Why must Step 5 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 5 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The mixture needs to be cooked in the pot before adding the rice to the soup.\"\n}"}
{"plan_idx": 222, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 222, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Blanching the spinach leaves makes them easier to work with and more pliable for wrapping the cheese mix.\"\n}"}
{"plan_idx": 223, "title": "chocolate-chocolate-cake", "question_idx": 223, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 2 happen before Step 10?", "why_question": "Why must Step 2 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 2 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the chocolate needs to be melted and cooled before it can be added to the mixture.\"\n}"}
{"plan_idx": 224, "title": "chocolate-chocolate-cake", "question_idx": 224, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chocolate needs to be melted and then cooled before being added to the mixture in Step 10.\"\n}"}
{"plan_idx": 225, "title": "curried bbq mussels", "question_idx": 225, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 6 because the curry mixture needs to be dotted on the mussels before the red pepper, parsley, and lime slices are sprinkled over the top.\"\n}"}
{"plan_idx": 226, "title": "spicy-tomato-anchovy-pasta", "question_idx": 226, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 7 happen before Step 10?", "why_question": "Why must Step 7 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 7 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 10 because the linguine needs to be cooked and drained before being tossed with the anchovy mixture and served immediately.\"\n}"}
{"plan_idx": 227, "title": "slow cooker butter chicken", "question_idx": 227, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 5 because the ingredients from Step 2 need to be cooked and combined before being transferred to the slow cooker in Step 5.\"\n}"}
{"plan_idx": 228, "title": "spicy-tomato-anchovy-pasta", "question_idx": 228, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 2 happen before Step 10?", "why_question": "Why must Step 2 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 2 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 does not need to happen before Step 10 because the pasta can be cooked and ready to be tossed with the anchovy mixture while the vegetables are still simmering.\" \n}"}
{"plan_idx": 229, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 229, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 13], "binary_question": "Must Step 2 happen before Step 14?", "why_question": "Why must Step 2 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 2 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 14 because the shortcakes need to be prepared before assembling the dessert.\"\n}"}
{"plan_idx": 230, "title": "chocolate-chocolate-cake", "question_idx": 230, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 20], "binary_question": "Must Step 7 happen before Step 21?", "why_question": "Why must Step 7 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 7 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 21 can happen before Step 7 as it is not dependent on the completion of Step 7.\"\n}"}
{"plan_idx": 231, "title": "creamy-chayote-squash-soup", "question_idx": 231, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 9 because the squash needs to be cooked and softened before being pureed into a smooth soup.\"\n}"}
{"plan_idx": 232, "title": "easy strawberry tart", "question_idx": 232, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The strawberries need to be well coated before pouring into the base.\"\n}"}
{"plan_idx": 233, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 233, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 15], "binary_question": "Must Step 6 happen before Step 16?", "why_question": "Why must Step 6 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 6 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 16 because the dough needs to be divided and shaped into circles before baking.\" \n}"}
{"plan_idx": 234, "title": "fusilli-and-meatballs", "question_idx": 234, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 4 happen before Step 13?", "why_question": "Why must Step 4 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 4 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 13 because the onion mixture is needed to mix with the other ingredients to form the meatballs.\"\n}"}
{"plan_idx": 235, "title": "brown sugar shortbread", "question_idx": 235, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 4 because the flour needs to be added before mixing well.\"\n}"}
{"plan_idx": 236, "title": "chocolate-chocolate-cake", "question_idx": 236, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 16], "binary_question": "Must Step 12 happen before Step 17?", "why_question": "Why must Step 12 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, step 12 does not need to happen before step 17 because step 12 involves preparing the egg whites, while step 17 involves baking the cake.\"\n}"}
{"plan_idx": 237, "title": "almond and apple cake", "question_idx": 237, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 4 happen before Step 7?", "why_question": "Why must Step 4 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 4 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 7 because the eggs need to be beaten well with the butter and sugar before adding the flour and milk.\"\n}"}
{"plan_idx": 238, "title": "almond and apple cake", "question_idx": 238, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 8 happen before Step 11?", "why_question": "Why must Step 8 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The flour and milk need to be combined with the mixture before spooning it into the tin.\"\n}"}
{"plan_idx": 239, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 239, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 can happen before Step 4 as the order of adding tuna and peppers to the mushrooms does not affect the overall outcome.\"\n}"}
{"plan_idx": 240, "title": "spiced butternut squash soup", "question_idx": 240, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 13], "binary_question": "Must Step 10 happen before Step 14?", "why_question": "Why must Step 10 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 10 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be added to the pot before seasoning the soup.\"\n}"}
{"plan_idx": 241, "title": "rouille", "question_idx": 241, "steps": ["In a mortar, crush the garlic to a fine mash.", "Transfer to a mixing bowl.", "Add the egg yolks, and beat into a mayonnaise while adding the olive oil.", "When the sauce is thick and smooth, stir in the cayenne pepper and saffron."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: rouille\n\nProcedure:\n1. In a mortar, crush the garlic to a fine mash.\n2. Transfer to a mixing bowl.\n3. Add the egg yolks, and beat into a mayonnaise while adding the olive oil.\n4. When the sauce is thick and smooth, stir in the cayenne pepper and saffron.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 4 because the cayenne pepper and saffron are stirred into the mayonnaise, which is created in Step 3.\"\n}"}
{"plan_idx": 242, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 242, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 9 because the peppers need to be mixed into the mushrooms before adding the tuna and parsley.\"\n}"}
{"plan_idx": 243, "title": "lightly spiced tomato and red lentil soup", "question_idx": 243, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 2 happen before Step 11?", "why_question": "Why must Step 2 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 2 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 11 because the onions need to soften before the soup is seasoned and reheated.\"\n}"}
{"plan_idx": 244, "title": "banana-split-cake", "question_idx": 244, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 1 happen before Step 4?", "why_question": "Why must Step 1 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 1 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is preheating the oven, which needs to happen before baking the base in Step 4.\"\n}"}
{"plan_idx": 245, "title": "one-pot irish stew", "question_idx": 245, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 3 because it involves cooking the lamb and creating the base for the stew before adding the onion and potatoes.\"\n}"}
{"plan_idx": 246, "title": "almond and apple cake", "question_idx": 246, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 13], "binary_question": "Must Step 6 happen before Step 14?", "why_question": "Why must Step 6 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 6 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The almond and apple cake needs to be baked before it can be served warm.\"\n}"}
{"plan_idx": 247, "title": "chicken and vegetable pie", "question_idx": 247, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 14], "binary_question": "Must Step 9 happen before Step 15?", "why_question": "Why must Step 9 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 9 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The hot liquid mixture needs to be prepared before it can be poured over the chicken mixture and baked in the oven.\"\n}"}
{"plan_idx": 248, "title": "chicken and vegetable pie", "question_idx": 248, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 7 happen before Step 8?", "why_question": "Why must Step 7 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 7 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 8 because the liquid mixture needs to be slowly stirred in to prevent lumps from forming.\"\n}"}
{"plan_idx": 249, "title": "spicy-tomato-anchovy-pasta", "question_idx": 249, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 9 happen before Step 10?", "why_question": "Why must Step 9 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 9 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen after Step 9, but it is not a requirement for Step 9 to happen before Step 10.\"\n}"}
{"plan_idx": 250, "title": "one-pot irish stew", "question_idx": 250, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 1 happen before Step 6?", "why_question": "Why must Step 1 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 1 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 6 because the lamb needs to be cooked and seasoned before adding the parsley or leeks.\"\n}"}
{"plan_idx": 251, "title": "chicken and vegetable pie", "question_idx": 251, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 5 happen before Step 14?", "why_question": "Why must Step 5 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 5 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 14 because the filling needs to be prepared and placed in the pie dish before covering it with pastry and baking it.\"\n}"}
{"plan_idx": 252, "title": "spiced butternut squash soup", "question_idx": 252, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 14], "binary_question": "Must Step 12 happen before Step 15?", "why_question": "Why must Step 12 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 12 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be mashed with the potatoes before adding the seasonings and other ingredients in Step 15.\"\n}"}
{"plan_idx": 253, "title": "chocolate-chocolate-cake", "question_idx": 253, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 15], "binary_question": "Must Step 6 happen before Step 16?", "why_question": "Why must Step 6 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The mixture needs to be prepared before pouring it into the cake tin.\"\n}"}
{"plan_idx": 254, "title": "vegetable-terrine", "question_idx": 254, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 14], "binary_question": "Must Step 9 happen before Step 15?", "why_question": "Why must Step 9 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 9 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 15 because the terrine needs to be refrigerated for several hours until firm before serving chilled.\"\n}"}
{"plan_idx": 255, "title": "vegetable-terrine", "question_idx": 255, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 1 happen before Step 9?", "why_question": "Why must Step 1 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 1 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The gelatin needs to be softened before being added to the cream mixture in Step 6.\"\n}"}
{"plan_idx": 256, "title": "fusilli-and-meatballs", "question_idx": 256, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [15, 17], "binary_question": "Must Step 16 happen before Step 18?", "why_question": "Why must Step 16 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 16 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be browned before being added to the tomato sauce to ensure they are fully cooked and have a nice texture.\"\n}"}
{"plan_idx": 257, "title": "easy strawberry tart", "question_idx": 257, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 5 because the mixture needs to be boiled before pouring it into the biscuit base.\"\n}"}
{"plan_idx": 258, "title": "no-sugar-rock-cakes", "question_idx": 258, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 7 happen before Step 8?", "why_question": "Why must Step 7 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 7 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 8 because the dough needs to be spaced out on the baking tray before it is baked.\"\n}"}
{"plan_idx": 259, "title": "slow cooker butter chicken", "question_idx": 259, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The ingredients need to be combined in the slow cooker before seasoning and cooking.\" \n}"}
{"plan_idx": 260, "title": "balsamic-and-mozzarella-chicken", "question_idx": 260, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the chicken needs to be cooked before adding the mozzarella, basil, and tomato.\"\n}"}
{"plan_idx": 261, "title": "chicken and vegetable pie", "question_idx": 261, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 7 happen before Step 12?", "why_question": "Why must Step 7 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 7 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The hot liquid mixture needs to be poured over the chicken before it is covered with the top pastry.\"\n}"}
{"plan_idx": 262, "title": "shellabina-s-corned-beef-hash", "question_idx": 262, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can happen after Step 5, but it is not necessary for Step 5 to happen before Step 6.\"\n}"}
{"plan_idx": 263, "title": "spiced butternut squash soup", "question_idx": 263, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 7 happen before Step 9?", "why_question": "Why must Step 7 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 needs to happen before Step 9 because the chicken stock needs to be added to the pot before the potatoes are added and brought to a boil.\"\n}"}
{"plan_idx": 264, "title": "white bread", "question_idx": 264, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 8 happen before Step 10?", "why_question": "Why must Step 8 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 8 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 needs to happen before Step 10 because the dough needs to rise before it can be punched down and kneaded again.\"\n}"}
{"plan_idx": 265, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 265, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 2 happen before Step 8?", "why_question": "Why must Step 2 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 2 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The dough needs to be prepared and baked before assembling the shortcakes.\"\n}"}
{"plan_idx": 266, "title": "fusilli-and-meatballs", "question_idx": 266, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 20], "binary_question": "Must Step 11 happen before Step 21?", "why_question": "Why must Step 11 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 does not need to happen before Step 21 because the pasta can be cooked separately while the meatballs and sauce are being prepared.\"\n}"}
{"plan_idx": 267, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 267, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 6 because the lentils need to be cooked before they can be mixed with the tomatoes and served.\"\n}"}
{"plan_idx": 268, "title": "chicken-prawn-and-rice-soup", "question_idx": 268, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 12], "binary_question": "Must Step 2 happen before Step 13?", "why_question": "Why must Step 2 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 2 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 does not need to happen before Step 13 because it is not directly related to the serving and enjoying of the soup.\"\n}"}
{"plan_idx": 269, "title": "balsamic-and-mozzarella-chicken", "question_idx": 269, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the chicken needs to be cooked before it can be served with the balsamic vinegar and other toppings.\"\n}"}
{"plan_idx": 270, "title": "cranachan", "question_idx": 270, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 1 happen before Step 4?", "why_question": "Why must Step 1 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 1 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 4 because the oats need to be toasted and cooled before being added to the cream mixture.\"\n}"}
{"plan_idx": 271, "title": "tomato and basil salad", "question_idx": 271, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 1 happen before Step 4?", "why_question": "Why must Step 1 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 1 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can happen before Step 1 as drizzling the vinegar and oil does not depend on having an attractive serving plate ready.\"\n}"}
{"plan_idx": 272, "title": "scone-pastry", "question_idx": 272, "steps": ["Sift the flour, baking powder and salt into a bowl.", "Add the butter and rub in until the mixture resembles fine crumbs.", "Make a well in the centre and add the milk.", "Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.", "Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: scone-pastry\n\nProcedure:\n1. Sift the flour, baking powder and salt into a bowl.\n2. Add the butter and rub in until the mixture resembles fine crumbs.\n3. Make a well in the centre and add the milk.\n4. Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.\n5. Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 3 because the butter needs to be rubbed into the dry ingredients before adding the milk.\"\n}"}
{"plan_idx": 273, "title": "creamy-chayote-squash-soup", "question_idx": 273, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 2 happen before Step 8?", "why_question": "Why must Step 2 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 2 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 8 because the butter needs to be melted in the saucepan before the mixture can be poured into the liquidiser.\"\n}"}
{"plan_idx": 274, "title": "vegetable-terrine", "question_idx": 274, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 13], "binary_question": "Must Step 9 happen before Step 14?", "why_question": "Why must Step 9 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 9 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 14 because the terrine needs to be refrigerated for several hours until firm before it can be removed from the mould.\" \n}"}
{"plan_idx": 275, "title": "green-tofu-curry", "question_idx": 275, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 11 happen before Step 12?", "why_question": "Why must Step 11 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 11 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen before Step 12 because the green curry paste needs to be mixed into the coconut milk and simmered before being drizzled over the tofu and rice to serve.\"\n}"}
{"plan_idx": 276, "title": "fusilli-and-meatballs", "question_idx": 276, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 14], "binary_question": "Must Step 13 happen before Step 15?", "why_question": "Why must Step 13 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be shaped before they can be cooked.\"\n}"}
{"plan_idx": 277, "title": "spiced-guava-cake", "question_idx": 277, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the eggs need to be added before the flour and guava mixtures.\" \n}"}
{"plan_idx": 278, "title": "cranachan", "question_idx": 278, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 requires the oats to be cooled, which can only happen after toasting them in Step 3 and removing them from the tray in Step 5.\"\n}"}
{"plan_idx": 279, "title": "chocolate-chocolate-cake", "question_idx": 279, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 17], "binary_question": "Must Step 6 happen before Step 18?", "why_question": "Why must Step 6 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 18 can happen before Step 6 as the cake needs to be baked before checking if it's ready.\"\n}"}
{"plan_idx": 280, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 280, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 5 happen before Step 9?", "why_question": "Why must Step 5 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 5 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The dough needs to be prepared before baking the shortcakes.\"\n}"}
{"plan_idx": 281, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 281, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 8 because the grapefruit juice from segmenting the grapefruits is needed to mix with the cracked peppercorns for the dressing in Step 7.\"\n}"}
{"plan_idx": 282, "title": "vegetable-terrine", "question_idx": 282, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 14], "binary_question": "Must Step 11 happen before Step 15?", "why_question": "Why must Step 11 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 11 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen before Step 15 because the arrangement of the vegetables needs to be done before the terrine is refrigerated and set.\" \n}"}
{"plan_idx": 283, "title": "old-fashioned-welsh-rarebit", "question_idx": 283, "steps": ["Grate 250g well-flavoured mature Cheddar cheese (you can also use a good Double Gloucester or Shropshire) and put into a heavy-based medium-sized pan (preferably nonstick) with 10g butter, 1 tsp mustard (English, wholegrain or Dijon), plenty of ground black pepper and 4 tbsp ale or semi-skimmed milk.", "Set over a low heat and melt gently, stirring, until smooth and thick.", "Spoon onto 4 thick slices of toast and grill until browned and bubbling.", "Serve with grilled mushrooms and a leaf salad for a light lunch or snack."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: old-fashioned-welsh-rarebit\n\nProcedure:\n1. Grate 250g well-flavoured mature Cheddar cheese (you can also use a good Double Gloucester or Shropshire) and put into a heavy-based medium-sized pan (preferably nonstick) with 10g butter, 1 tsp mustard (English, wholegrain or Dijon), plenty of ground black pepper and 4 tbsp ale or semi-skimmed milk.\n2. Set over a low heat and melt gently, stirring, until smooth and thick.\n3. Spoon onto 4 thick slices of toast and grill until browned and bubbling.\n4. Serve with grilled mushrooms and a leaf salad for a light lunch or snack.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 3 because the cheese mixture needs to be melted and thickened before spooning it onto the toast and grilling.\"\n}"}
{"plan_idx": 284, "title": "fusilli-and-meatballs", "question_idx": 284, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 19], "binary_question": "Must Step 6 happen before Step 20?", "why_question": "Why must Step 6 happen before Step 20?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 6 happen before Step 20?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tomato sauce needs to be prepared before it can be tossed with the pasta in Step 20.\"\n}"}
{"plan_idx": 285, "title": "creamy-chayote-squash-soup", "question_idx": 285, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 5 because the squash needs to be cooked and stirred with the other ingredients before adding the stock and additional coriander.\" \n}"}
{"plan_idx": 286, "title": "very-vanilla-ry-cheesecake", "question_idx": 286, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 10 happen before Step 11?", "why_question": "Why must Step 10 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 10 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 must happen before Step 11 because the boiling water needs to be in the oven before placing the cheesecake in to bake.\"\n}"}
{"plan_idx": 287, "title": "white bread", "question_idx": 287, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 7 because the yeast mixture needs to be mixed with salt and oil before allowing it to rise.\"\n}"}
{"plan_idx": 288, "title": "spiced-pumpkin-teabread", "question_idx": 288, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 11], "binary_question": "Must Step 6 happen before Step 12?", "why_question": "Why must Step 6 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 6 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 must happen before Step 6 because the teabread needs to cool in the tin before being removed and sliced.\"\n}"}
{"plan_idx": 289, "title": "spiced butternut squash soup", "question_idx": 289, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 needs to happen before Step 6 because the squash needs to cool slightly before removing the peel.\"\n}"}
{"plan_idx": 290, "title": "spiced butternut squash soup", "question_idx": 290, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 4 because the squash needs to be baked before it can be pierced with a fork to check for doneness.\"\n}"}
{"plan_idx": 291, "title": "fusilli-and-meatballs", "question_idx": 291, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 16], "binary_question": "Must Step 13 happen before Step 17?", "why_question": "Why must Step 13 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be shaped before they can be cooked and added to the sauce.\"\n}"}
{"plan_idx": 292, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 292, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 8 happen before Step 10?", "why_question": "Why must Step 8 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 8 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 8 must happen before Step 10 because the peppers and mushrooms need to be mixed with the tuna and parsley before serving.\"\n}"}
{"plan_idx": 293, "title": "white bread", "question_idx": 293, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 2 happen before Step 8?", "why_question": "Why must Step 2 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 2 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 8 because the yeast needs time to proof and allow the dough to rise before punching it down and allowing it to rise again.\"\n}"}
{"plan_idx": 294, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 294, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to bring the water to a boil before adding the lentils in Step 2.\"\n}"}
{"plan_idx": 295, "title": "almond and apple cake", "question_idx": 295, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 3 happen before Step 10?", "why_question": "Why must Step 3 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 3 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The baking parchment needs to be in place before arranging the apple in the tin to prevent sticking.\"\n}"}
{"plan_idx": 296, "title": "chocolate-chocolate-cake", "question_idx": 296, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 15], "binary_question": "Must Step 9 happen before Step 16?", "why_question": "Why must Step 9 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 9 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The flour needs to be added to the mixture before pouring it into the cake tin.\"\n}"}
{"plan_idx": 297, "title": "almond and apple cake", "question_idx": 297, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 4 happen before Step 13?", "why_question": "Why must Step 4 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 4 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 13 because the cake needs to cool slightly before being turned onto a serving plate.\"\n}"}
{"plan_idx": 298, "title": "chocolate-pancake-batter", "question_idx": 298, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 9 happen before Step 11?", "why_question": "Why must Step 9 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 9 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 11 because the pancakes need to be cooked before they are stacked to keep warm.\"\n}"}
{"plan_idx": 299, "title": "spiced butternut squash soup", "question_idx": 299, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [15, 16], "binary_question": "Must Step 16 happen before Step 17?", "why_question": "Why must Step 16 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 16 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The soup needs to be heated through before ladling into bowls.\"\n}"}
{"plan_idx": 300, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 300, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 3 because the dry ingredients need to be combined before rubbing the butter into the flour.\"\n}"}
{"plan_idx": 301, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 301, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 15], "binary_question": "Must Step 13 happen before Step 16?", "why_question": "Why must Step 13 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The whipped cream needs to be prepared before assembling the shortcakes in step 16.\"\n}"}
{"plan_idx": 302, "title": "chocolate-pancake-batter", "question_idx": 302, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 1 happen before Step 11?", "why_question": "Why must Step 1 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 1 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 11 because the pancake batter needs to be prepared before cooking the pancakes.\"\n}"}
{"plan_idx": 303, "title": "lightly spiced tomato and red lentil soup", "question_idx": 303, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 9 happen before Step 12?", "why_question": "Why must Step 9 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 9 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The soup needs to be blended before it can be served with the coriander yoghurt and black pepper.\"\n}"}
{"plan_idx": 304, "title": "curried bbq mussels", "question_idx": 304, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 7 happen before Step 8?", "why_question": "Why must Step 7 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 7 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The lime slices need to be placed on top of the mussels before wrapping them in foil for cooking.\"\n}"}
{"plan_idx": 305, "title": "no-sugar-rock-cakes", "question_idx": 305, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 6 because the flour, Splenda, and butter need to be mixed together before adding the egg and currants to form the dough.\"\n}"}
{"plan_idx": 306, "title": "chocolate-chocolate-cake", "question_idx": 306, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 15], "binary_question": "Must Step 10 happen before Step 16?", "why_question": "Why must Step 10 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the cooled chocolate needs to be added to the mixture before pouring it into the cake tin.\"\n}"}
{"plan_idx": 307, "title": "almond and apple cake", "question_idx": 307, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 7 because the ground almonds need to be stirred in before adding the flour and milk.\"\n}"}
{"plan_idx": 308, "title": "spiced butternut squash soup", "question_idx": 308, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 1 happen before Step 12?", "why_question": "Why must Step 1 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 1 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be baked before it can be mashed with the potatoes in Step 12.\"\n}"}
{"plan_idx": 309, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 309, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 14], "binary_question": "Must Step 9 happen before Step 15?", "why_question": "Why must Step 9 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 9 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The shortcakes need to be baked before they can be assembled with the strawberries and whipped cream.\"\n}"}
{"plan_idx": 310, "title": "spiced butternut squash soup", "question_idx": 310, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 needs to happen before Step 5 because the squash needs to be baked before the peel can be removed.\"\n}"}
{"plan_idx": 311, "title": "chocolate-chocolate-cake", "question_idx": 311, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 3 happen before Step 10?", "why_question": "Why must Step 3 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 3 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chocolate needs to be cooled before adding it to the mix.\"\n}"}
{"plan_idx": 312, "title": "easy strawberry tart", "question_idx": 312, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 3 because the ingredients need to be mixed and boiled before being removed from heat.\"\n}"}
{"plan_idx": 313, "title": "spiced butternut squash soup", "question_idx": 313, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 16], "binary_question": "Must Step 13 happen before Step 17?", "why_question": "Why must Step 13 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 13 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 13 must happen before Step 17 because the soup needs to be pureed before it is ladled into bowls.\"\n}"}
{"plan_idx": 314, "title": "chicken and vegetable pie", "question_idx": 314, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 10 happen before Step 11?", "why_question": "Why must Step 10 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 must happen before Step 11 because the pie dish needs to be prepared before placing the chicken mixture in it.\"\n}"}
{"plan_idx": 315, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 315, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 needs to happen before Step 5 because the mushrooms need to give up their juices before adding the other ingredients for the sauce.\"\n}"}
{"plan_idx": 316, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 316, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 7 because the dough needs to be kneaded before it is divided and shaped into circles.\"\n}"}
{"plan_idx": 317, "title": "chocolate-chocolate-cake", "question_idx": 317, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 20], "binary_question": "Must Step 12 happen before Step 21?", "why_question": "Why must Step 12 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, step 12 does not need to happen before step 21 because they are independent of each other and can happen in any order.\"\n}"}
{"plan_idx": 318, "title": "shellabina-s-corned-beef-hash", "question_idx": 318, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 1 happen before Step 5?", "why_question": "Why must Step 1 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 1 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the potatoes, carrots, and onion need to be cooked before the gravy granules are added to thicken the stew.\"\n}"}
{"plan_idx": 319, "title": "white bread", "question_idx": 319, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 5 happen before Step 12?", "why_question": "Why must Step 5 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 5 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 12 because the dough needs to be kneaded and shaped into loaves before allowing it to rise again.\"\n}"}
{"plan_idx": 320, "title": "vegetable-terrine", "question_idx": 320, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 4 happen before Step 13?", "why_question": "Why must Step 4 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 4 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 13 because the chopped sorrel needs to be added to the cream mixture before pouring it into the mould and refrigerating.\" \n}"}
{"plan_idx": 321, "title": "tortellini-fritto-with-almond-butter", "question_idx": 321, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 2 happen before Step 7?", "why_question": "Why must Step 2 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 2 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 7 because the tortellini needs to be cooked before serving.\"\n}"}
{"plan_idx": 322, "title": "spiced butternut squash soup", "question_idx": 322, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 4 happen before Step 13?", "why_question": "Why must Step 4 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 4 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be baked and then mashed before it can be pureed in Step 13.\"\n}"}
{"plan_idx": 323, "title": "white bread", "question_idx": 323, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 4 happen before Step 6?", "why_question": "Why must Step 4 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 4 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 6 because the flour needs to be gradually mixed into the yeast mixture before kneading the dough on a lightly floured surface.\"\n}"}
{"plan_idx": 324, "title": "spiced-pumpkin-teabread", "question_idx": 324, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 5 because the pumpkin needs to be mashed and mixed with honey and sultanas before adding the other ingredients.\"\n}"}
{"plan_idx": 325, "title": "spiced-pumpkin-teabread", "question_idx": 325, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 8 happen before Step 10?", "why_question": "Why must Step 8 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 8 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 10 because the pumpkin mixture needs to be added and evenly mixed before the mixture is put into the tin and sprinkled with pumpkin seeds.\"\n}"}
{"plan_idx": 326, "title": "chicken-prawn-and-rice-soup", "question_idx": 326, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The prawns and chicken mixture needs to be cooked before adding salt and sherry in Step 7.\"\n}"}
{"plan_idx": 327, "title": "white bread", "question_idx": 327, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 4 happen before Step 12?", "why_question": "Why must Step 4 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 4 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 4 must happen before Step 12 because the dough needs to rise before it can be shaped into loaves and allowed to rise again.\"\n}"}
{"plan_idx": 328, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 328, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 5 because the dough needs to be formed before it can be kneaded.\"\n}"}
{"plan_idx": 329, "title": "spiced-pumpkin-teabread", "question_idx": 329, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 5 happen before Step 12?", "why_question": "Why must Step 5 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 5 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 can happen before Step 5 as it is not dependent on the completion of Step 5.\"\n}"}
{"plan_idx": 330, "title": "fusilli-and-meatballs", "question_idx": 330, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 19], "binary_question": "Must Step 7 happen before Step 20?", "why_question": "Why must Step 7 happen before Step 20?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 7 happen before Step 20?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The pasta should be cooked and tossed with the sauce before serving, which requires the sauce to be ready by Step 20.\"\n}"}
{"plan_idx": 331, "title": "cranachan", "question_idx": 331, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 5 to allow the toasted oats to cool before being added to the cream mixture.\"\n}"}
{"plan_idx": 332, "title": "chocolate-chocolate-cake", "question_idx": 332, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [14, 20], "binary_question": "Must Step 15 happen before Step 21?", "why_question": "Why must Step 15 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 15 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 15 must happen before Step 21 because the cake needs to cool in the tin before being removed and allowed to cool completely.\"\n}"}
{"plan_idx": 333, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 333, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 6 because the cheese mix needs to be wrapped in the spinach leaves before brushing with olive oil.\"\n}"}
{"plan_idx": 334, "title": "spiced butternut squash soup", "question_idx": 334, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 13], "binary_question": "Must Step 11 happen before Step 14?", "why_question": "Why must Step 11 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be cooked and mashed with the potatoes before seasoning the soup.\"\n}"}
{"plan_idx": 335, "title": "balsamic-and-mozzarella-chicken", "question_idx": 335, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 1 happen before Step 10?", "why_question": "Why must Step 1 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 1 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 1 does not need to happen before Step 10 because the marinating process can occur while other steps are being completed.\"\n}"}
{"plan_idx": 336, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 336, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 2 happen before Step 10?", "why_question": "Why must Step 2 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 2 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 10 because the shortcakes need to be baked before they can be cooled and assembled.\"\n}"}
{"plan_idx": 337, "title": "brown sugar shortbread", "question_idx": 337, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 2 happen before Step 9?", "why_question": "Why must Step 2 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 2 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 2 must happen before Step 9 because creaming the butter and brown sugar is the first step in preparing the dough for the shortbread.\" \n}"}
{"plan_idx": 338, "title": "fusilli-and-meatballs", "question_idx": 338, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 6 happen before Step 9?", "why_question": "Why must Step 6 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 6 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tomatoes need to be processed before being brought to a boil in the saucepan.\"\n}"}
{"plan_idx": 339, "title": "strawberry-tiramisu-trifle", "question_idx": 339, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 4 happen before Step 6?", "why_question": "Why must Step 4 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 4 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 6 because the soaked sponge fingers need to be lined in the glass bowl before adding the strawberries.\"\n}"}
{"plan_idx": 340, "title": "chicken and vegetable pie", "question_idx": 340, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [13, 15], "binary_question": "Must Step 14 happen before Step 16?", "why_question": "Why must Step 14 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 14 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 16 can happen before Step 14, as the cooling time is not dependent on the slits in the pastry.\"\n}"}
{"plan_idx": 341, "title": "very-vanilla-ry-cheesecake", "question_idx": 341, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 12], "binary_question": "Must Step 12 happen before Step 13?", "why_question": "Why must Step 12 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 12 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cheesecake needs to cool down inside the oven before being covered and refrigerated to set properly.\"\n}"}
{"plan_idx": 342, "title": "one-pot irish stew", "question_idx": 342, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, step 7 can happen after step 6 as seasoning can be added before or after stirring in fresh parsley or chopped leeks.\"\n}"}
{"plan_idx": 343, "title": "creamy-chayote-squash-soup", "question_idx": 343, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 needs to happen before Step 7 because the stock needs to be stirred in before covering and simmering the soup for 20 minutes.\"\n}"}
{"plan_idx": 344, "title": "lightly spiced tomato and red lentil soup", "question_idx": 344, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 6 happen before Step 11?", "why_question": "Why must Step 6 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 6 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 11 because the soup needs to simmer for 25-30 minutes to allow the lentils and vegetables to become very soft before being seasoned and reheated.\" \n}"}
{"plan_idx": 345, "title": "very-vanilla-ry-cheesecake", "question_idx": 345, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 9 happen before Step 13?", "why_question": "Why must Step 9 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 9 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cheesecake needs to be poured into the biscuit base before it can be covered and refrigerated.\"\n}"}
{"plan_idx": 346, "title": "vegetable-terrine", "question_idx": 346, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 14], "binary_question": "Must Step 8 happen before Step 15?", "why_question": "Why must Step 8 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 8 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The terrine needs to be refrigerated for several hours until firm before it can be served chilled.\"\n}"}
{"plan_idx": 347, "title": "chicken-prawn-and-rice-soup", "question_idx": 347, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 1 happen before Step 6?", "why_question": "Why must Step 1 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 1 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The prawns and chicken mixture needs to be added to the pot with the stock before bringing it to a boil in Step 6.\"\n}"}
{"plan_idx": 348, "title": "easy strawberry tart", "question_idx": 348, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 2 because the ingredients need to be mixed together before boiling.\"\n}"}
{"plan_idx": 349, "title": "spiced-pumpkin-teabread", "question_idx": 349, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 7 happen before Step 11?", "why_question": "Why must Step 7 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 7 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 needs to happen before Step 11 because the mixture needs to be prepared and put into the tin before baking.\"\n}"}
{"plan_idx": 350, "title": "curried bbq mussels", "question_idx": 350, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 1 happen before Step 10?", "why_question": "Why must Step 1 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 1 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 10 because the barbecue needs to be preheated before cooking the mussels, and Step 10 involves discarding any mussels that do not open during cooking.\"\n}"}
{"plan_idx": 351, "title": "spiced butternut squash soup", "question_idx": 351, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 14], "binary_question": "Must Step 13 happen before Step 15?", "why_question": "Why must Step 13 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 13 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 13 must happen before Step 15 because the spices and other seasonings need to be added after the soup is pureed and smooth.\"\n}"}
{"plan_idx": 352, "title": "chocolate-pancake-batter", "question_idx": 352, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 6 because the pan needs to be heated before greasing it with oil.\"\n}"}
{"plan_idx": 353, "title": "spiced-pumpkin-teabread", "question_idx": 353, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 1 happen before Step 13?", "why_question": "Why must Step 1 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 1 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 13 because the teabread needs to be baked and cooled before being brushed with honey.\"\n}"}
{"plan_idx": 354, "title": "white bread", "question_idx": 354, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 7 happen before Step 10?", "why_question": "Why must Step 7 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 7 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen before Step 7 because the dough needs to be punched down before shaping into loaves, and the rising time can be adjusted accordingly.\"\n}"}
{"plan_idx": 355, "title": "simple-basic-cupcakes", "question_idx": 355, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 2 happen before Step 9?", "why_question": "Why must Step 2 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 2 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 9 because the cupcakes need to be fully baked and cooled before decorating.\"\n}"}
{"plan_idx": 356, "title": "chicken-prawn-and-rice-soup", "question_idx": 356, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 7 because the prawns and chicken mixture needs to be cooked before adding salt and sherry to the soup.\"\n}"}
{"plan_idx": 357, "title": "frugal-beef-stew", "question_idx": 357, "steps": ["Add the onion and beef to a frying pan with a little oil (if you feel it requires it, depends on how good your pan is) and cook until the onions are soft.", "Tip out the onion/beef into a casserole dish and add the rest of the ingredients to the frying pan with half the stock, cooking on a high heat for about 10 minutes.", "Pour the contents of the frying pan into the casserole dish along with the thyme and rest of the stock (and a little bit of pepper if you like) and put on the lid.", "Cook in the oven on a low heat (about 140 C) for around 3-4 hours, giving it a stir every hour."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: frugal-beef-stew\n\nProcedure:\n1. Add the onion and beef to a frying pan with a little oil (if you feel it requires it, depends on how good your pan is) and cook until the onions are soft.\n2. Tip out the onion/beef into a casserole dish and add the rest of the ingredients to the frying pan with half the stock, cooking on a high heat for about 10 minutes.\n3. Pour the contents of the frying pan into the casserole dish along with the thyme and rest of the stock (and a little bit of pepper if you like) and put on the lid.\n4. Cook in the oven on a low heat (about 140 C) for around 3-4 hours, giving it a stir every hour.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 4 because the ingredients need to be combined and the lid put on before cooking in the oven.\"\n}"}
{"plan_idx": 358, "title": "banana-split-cake", "question_idx": 358, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 4 happen before Step 10?", "why_question": "Why must Step 4 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 4 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The base needs to be cooled before adding the bananas and strawberries.\"\n}"}
{"plan_idx": 359, "title": "apple-pumpkin-spread", "question_idx": 359, "steps": ["In a medium saucepan over medium heat, mix pumpkin puree, apple sauce, apple juice, dark brown soft sugar and spices.", "Bring mixture to the boil.", "Reduce heat and simmer approximately 1 1/2 hours.", "Transfer to sterile containers and chill in the refrigerator until serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: apple-pumpkin-spread\n\nProcedure:\n1. In a medium saucepan over medium heat, mix pumpkin puree, apple sauce, apple juice, dark brown soft sugar and spices.\n2. Bring mixture to the boil.\n3. Reduce heat and simmer approximately 1 1/2 hours.\n4. Transfer to sterile containers and chill in the refrigerator until serving.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 4 because the mixture needs to be simmered before it is transferred to sterile containers and chilled.\" \n}"}
{"plan_idx": 360, "title": "chicken and vegetable pie", "question_idx": 360, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 15], "binary_question": "Must Step 12 happen before Step 16?", "why_question": "Why must Step 12 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 12 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 12 must happen before Step 16 because the pie needs to be baked before it can be cooled and served.\"\n}"}
{"plan_idx": 361, "title": "chicken and vegetable pie", "question_idx": 361, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 15], "binary_question": "Must Step 6 happen before Step 16?", "why_question": "Why must Step 6 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 6 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 does not need to happen before Step 16 because Step 6 involves preparing the filling while Step 16 involves baking the pie.\"\n}"}
{"plan_idx": 362, "title": "spiced butternut squash soup", "question_idx": 362, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 4 happen before Step 14?", "why_question": "Why must Step 4 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 4 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the squash needs to be baked and then added to the soup before seasoning and heating through.\"\n}"}
{"plan_idx": 363, "title": "chocolate-pancake-batter", "question_idx": 363, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 2 happen before Step 10?", "why_question": "Why must Step 2 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 2 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 10 because the batter needs to be prepared before cooking the pancakes.\"\n}"}
{"plan_idx": 364, "title": "old-fashioned-welsh-rarebit", "question_idx": 364, "steps": ["Grate 250g well-flavoured mature Cheddar cheese (you can also use a good Double Gloucester or Shropshire) and put into a heavy-based medium-sized pan (preferably nonstick) with 10g butter, 1 tsp mustard (English, wholegrain or Dijon), plenty of ground black pepper and 4 tbsp ale or semi-skimmed milk.", "Set over a low heat and melt gently, stirring, until smooth and thick.", "Spoon onto 4 thick slices of toast and grill until browned and bubbling.", "Serve with grilled mushrooms and a leaf salad for a light lunch or snack."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: old-fashioned-welsh-rarebit\n\nProcedure:\n1. Grate 250g well-flavoured mature Cheddar cheese (you can also use a good Double Gloucester or Shropshire) and put into a heavy-based medium-sized pan (preferably nonstick) with 10g butter, 1 tsp mustard (English, wholegrain or Dijon), plenty of ground black pepper and 4 tbsp ale or semi-skimmed milk.\n2. Set over a low heat and melt gently, stirring, until smooth and thick.\n3. Spoon onto 4 thick slices of toast and grill until browned and bubbling.\n4. Serve with grilled mushrooms and a leaf salad for a light lunch or snack.\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 3 because the cheese mixture needs to be prepared and melted before spooning onto the toast and grilling.\"\n}"}
{"plan_idx": 365, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 365, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 14], "binary_question": "Must Step 13 happen before Step 15?", "why_question": "Why must Step 13 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 13 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 can happen before Step 13 because the whipped cream can be prepared and used as a topping before assembling the shortcakes.\"\n}"}
{"plan_idx": 366, "title": "almond and apple cake", "question_idx": 366, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 9 happen before Step 13?", "why_question": "Why must Step 9 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 9 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen before Step 9 because the cake needs to cool slightly before being turned onto a serving plate.\"\n}"}
{"plan_idx": 367, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 367, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 9 happen before Step 10?", "why_question": "Why must Step 9 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 9 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The shortcakes need to cool before the lemon butter is spread on them.\"\n}"}
{"plan_idx": 368, "title": "simple-basic-cupcakes", "question_idx": 368, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 5 because the eggs need to be fully incorporated into the batter before adding the flour.\"\n}"}
{"plan_idx": 369, "title": "curried bbq mussels", "question_idx": 369, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 8 because the curry mixture needs to be added to the mussels before they are wrapped in foil and cooked.\" \n}"}
{"plan_idx": 370, "title": "spiced butternut squash soup", "question_idx": 370, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 is necessary to create the right conditions for baking the squash in the oven.\"\n}"}
{"plan_idx": 371, "title": "vegetable-terrine", "question_idx": 371, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 6 happen before Step 13?", "why_question": "Why must Step 6 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 6 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The gelatin needs to be added to the cream mixture before it is refrigerated to allow the terrine to set properly.\"\n}"}
{"plan_idx": 372, "title": "chocolate-chocolate-cake", "question_idx": 372, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 16], "binary_question": "Must Step 6 happen before Step 17?", "why_question": "Why must Step 6 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 17 must happen before Step 6 because the cake needs to be baked before it can be removed from the tin and allowed to cool.\"\n}"}
{"plan_idx": 373, "title": "vegetable-terrine", "question_idx": 373, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 13], "binary_question": "Must Step 12 happen before Step 14?", "why_question": "Why must Step 12 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 12 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 12 must happen before Step 14 because the terrine needs to be refrigerated for several hours until firm before it can be released from the mould.\" \n}"}
{"plan_idx": 374, "title": "chicken-prawn-and-rice-soup", "question_idx": 374, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 12], "binary_question": "Must Step 7 happen before Step 13?", "why_question": "Why must Step 7 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 7 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 13 because the salt and sherry need to be added to the soup before it is served and enjoyed.\"\n}"}
{"plan_idx": 375, "title": "spiced butternut squash soup", "question_idx": 375, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 15], "binary_question": "Must Step 13 happen before Step 16?", "why_question": "Why must Step 13 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 13 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 13 must happen before Step 16 because the soup needs to be pureed before being heated through.\"\n}"}
{"plan_idx": 376, "title": "curried bbq mussels", "question_idx": 376, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 6 happen before Step 10?", "why_question": "Why must Step 6 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 6 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 10 because the mussels need to be checked for opening before discarding any that do not open.\"\n}"}
{"plan_idx": 377, "title": "chocolate-chocolate-cake", "question_idx": 377, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 20], "binary_question": "Must Step 6 happen before Step 21?", "why_question": "Why must Step 6 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 21 because the cake needs to cool in the tin before being removed, and Step 6 involves beating the butter and margarine together, which is necessary for the cake mixture.\"\n}"}
{"plan_idx": 378, "title": "busters-liver-dinner", "question_idx": 378, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 3 because the ingredients need to be mixed together before adding hot water if necessary.\"\n}"}
{"plan_idx": 379, "title": "green-tofu-curry", "question_idx": 379, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 8 happen before Step 12?", "why_question": "Why must Step 8 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 8 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tofu needs to be seasoned with salt before serving with the curry and rice.\"\n}"}
{"plan_idx": 380, "title": "slow cooker butter chicken", "question_idx": 380, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 1 happen before Step 7?", "why_question": "Why must Step 1 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 1 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 1 does not need to happen before Step 7 because the slow cooker will continue to cook the ingredients, including the chicken, after they are transferred from the frying pan.\" \n}"}
{"plan_idx": 381, "title": "chicken and vegetable pie", "question_idx": 381, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 4 happen before Step 12?", "why_question": "Why must Step 4 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 4 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chicken mixture needs to be prepared and set aside before it can be placed in the pie dish in Step 12.\"\n}"}
{"plan_idx": 382, "title": "fusilli-and-meatballs", "question_idx": 382, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 17], "binary_question": "Must Step 5 happen before Step 18?", "why_question": "Why must Step 5 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 5 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tomato sauce needs to be prepared before adding the meatballs to it.\"\n}"}
{"plan_idx": 383, "title": "chocolate-chocolate-cake", "question_idx": 383, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 17], "binary_question": "Must Step 12 happen before Step 18?", "why_question": "Why must Step 12 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 12 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 18 happens before Step 12 because the cake needs to be baked before checking if it's ready.\"\n}"}
{"plan_idx": 384, "title": "easy-coconut-rice", "question_idx": 384, "steps": ["Combine rice with the coconut milk, water, salt, sugar and cinnamon stick in a large saucepan with a tight-fitting lid.", "Bring to the boil; reduce the heat to a simmer and cover.", "Cook until the liquid is absorbed and the rice is tender, about 25 minutes.", "Remove cinnamon stick to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy-coconut-rice\n\nProcedure:\n1. Combine rice with the coconut milk, water, salt, sugar and cinnamon stick in a large saucepan with a tight-fitting lid.\n2. Bring to the boil; reduce the heat to a simmer and cover.\n3. Cook until the liquid is absorbed and the rice is tender, about 25 minutes.\n4. Remove cinnamon stick to serve.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 4 because the cinnamon stick needs to be removed before serving the coconut rice.\"\n}"}
{"plan_idx": 385, "title": "spiced butternut squash soup", "question_idx": 385, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 15], "binary_question": "Must Step 7 happen before Step 16?", "why_question": "Why must Step 7 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 16 because the soup needs to be heated through before ladling into bowls.\"\n}"}
{"plan_idx": 386, "title": "almost no fat banana bread", "question_idx": 386, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 7 because the bread needs to be baked before it can be cooled and sliced.\"\n}"}
{"plan_idx": 387, "title": "almond and apple cake", "question_idx": 387, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 8 because the flour and milk need to be added gradually while stirring to ensure the mixture is well combined.\"\n}"}
{"plan_idx": 388, "title": "green-tofu-curry", "question_idx": 388, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 9 happen before Step 10?", "why_question": "Why must Step 9 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 9 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 10 because the coconut milk needs to be brought to a boil before mixing in the green curry paste.\"\n}"}
{"plan_idx": 389, "title": "spiced-pumpkin-teabread", "question_idx": 389, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 12], "binary_question": "Must Step 2 happen before Step 13?", "why_question": "Why must Step 2 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 2 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 13 because the loaf needs to be turned out onto a wire rack after cooling in the tin, and the baking parchment in the tin allows for easy removal.\"\n}"}
{"plan_idx": 390, "title": "almond and apple cake", "question_idx": 390, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 5 happen before Step 11?", "why_question": "Why must Step 5 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 5 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The eggs need to be added to the mixture before it is spooned into the tin and baked.\"\n}"}
{"plan_idx": 391, "title": "curried bbq mussels", "question_idx": 391, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 8 because the mussels need to be divided and placed on foil before wrapping and cooking.\"\n}"}
{"plan_idx": 392, "title": "almost no fat banana bread", "question_idx": 392, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 7 because the bread needs to be baked before it can be cooled and sliced.\"\n}"}
{"plan_idx": 393, "title": "balsamic-and-mozzarella-chicken", "question_idx": 393, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 8 happen before Step 10?", "why_question": "Why must Step 8 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 8 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 does not need to happen before Step 10 because the balsamic vinegar can be drizzled over the platter after serving.\"\n}"}
{"plan_idx": 394, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 394, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 5 happen before Step 9?", "why_question": "Why must Step 5 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 5 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 9 because the spinach rolls need to be grilled before they can cool for 10 minutes.\"\n}"}
{"plan_idx": 395, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 395, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 3 happen before Step 8?", "why_question": "Why must Step 3 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 3 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 8 because the mushrooms need to be cooked and seasoned before adding the roasted red peppers.\"\n}"}
{"plan_idx": 396, "title": "simple-basic-cupcakes", "question_idx": 396, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 6 because the batter needs to be fully mixed before spooning it into the muffin tin.\"\n}"}
{"plan_idx": 397, "title": "spiced-pumpkin-teabread", "question_idx": 397, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 12], "binary_question": "Must Step 3 happen before Step 13?", "why_question": "Why must Step 3 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 3 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 13 because the pumpkin needs to be cooked and mashed before brushing with honey.\" \n}"}
{"plan_idx": 398, "title": "spicy-tomato-anchovy-pasta", "question_idx": 398, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 3 because the anchovies and water are added to the pan in Step 3, so the vegetables need to be cooked before adding these ingredients.\"\n}"}
{"plan_idx": 399, "title": "vegetable-terrine", "question_idx": 399, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 12], "binary_question": "Must Step 5 happen before Step 13?", "why_question": "Why must Step 5 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cream mixture needs to be boiled and cooled before pouring it over the vegetables and refrigerating the terrine.\"\n}"}
{"plan_idx": 400, "title": "brown sugar shortbread", "question_idx": 400, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 9 happen before Step 10?", "why_question": "Why must Step 9 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 9 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 10 because the shortbread needs to be pricked with a fork before baking.\" \n}"}
{"plan_idx": 401, "title": "jam-drop-biscuits", "question_idx": 401, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the dough needs to be formed into balls before making a hollow and filling with jam.\"\n}"}
{"plan_idx": 402, "title": "fusilli-and-meatballs", "question_idx": 402, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 19], "binary_question": "Must Step 12 happen before Step 20?", "why_question": "Why must Step 12 happen before Step 20?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 12 happen before Step 20?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be cooked before being added to the sauce and pasta.\"\n}"}
{"plan_idx": 403, "title": "vegetable-terrine", "question_idx": 403, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cream mixture needs to be brought to a boil before adding the chopped sorrel and gelatin in order to properly mix and activate the gelatin.\" \n}"}
{"plan_idx": 404, "title": "no-sugar-rock-cakes", "question_idx": 404, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 6 because the dough needs to be mixed before it can be formed into balls.\"\n}"}
{"plan_idx": 405, "title": "chocolate-chocolate-cake", "question_idx": 405, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 21], "binary_question": "Must Step 3 happen before Step 22?", "why_question": "Why must Step 3 happen before Step 22?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 3 happen before Step 22?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 22 can happen after Step 3, as it is the final step for decoration after the cake has cooled completely.\"\n}"}
{"plan_idx": 406, "title": "creamy-chayote-squash-soup", "question_idx": 406, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 1 happen before Step 9?", "why_question": "Why must Step 1 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 1 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 9 because the stock needs to be dissolved before it can be added to the soup mixture and pureed.\"\n}"}
{"plan_idx": 407, "title": "banana-split-cake", "question_idx": 407, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 4 happen before Step 11?", "why_question": "Why must Step 4 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 4 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 11 because the base needs to be baked and cooled before adding the whipped cream and other toppings.\"\n}"}
{"plan_idx": 408, "title": "vegetable-terrine", "question_idx": 408, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 9 happen before Step 13?", "why_question": "Why must Step 9 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 9 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 13 because the cream mixture needs to set before the terrine can be refrigerated for several hours until firm.\"\n}"}
{"plan_idx": 409, "title": "banana-split-cake", "question_idx": 409, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 5 happen before Step 10?", "why_question": "Why must Step 5 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 5 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 10 because the base needs to cool before adding the bananas and strawberries.\"\n}"}
{"plan_idx": 410, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 410, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 14], "binary_question": "Must Step 6 happen before Step 15?", "why_question": "Why must Step 6 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 6 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 15 because the dough needs to be divided and shaped into circles before baking, cooling, and assembling the shortcakes.\"\n}"}
{"plan_idx": 411, "title": "almost no fat banana bread", "question_idx": 411, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 2 happen before Step 7?", "why_question": "Why must Step 2 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 2 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 7 because the loaf tin needs to be prepared before the batter is poured into it and baked.\" \n}"}
{"plan_idx": 412, "title": "spiced butternut squash soup", "question_idx": 412, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 16], "binary_question": "Must Step 4 happen before Step 17?", "why_question": "Why must Step 4 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 4 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 needs to happen before Step 17 because the squash needs to be baked and prepared before it can be added to the soup.\"\n}"}
{"plan_idx": 413, "title": "white bread", "question_idx": 413, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 4 happen before Step 7?", "why_question": "Why must Step 4 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 4 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 7 because the dough needs to rise, and the flour is added before the dough is allowed to rise.\" \n}"}
{"plan_idx": 414, "title": "chicken-prawn-and-rice-soup", "question_idx": 414, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 1 happen before Step 4?", "why_question": "Why must Step 1 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 1 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to mix the prawns, chicken, egg, and cornflour before cooking in Step 4.\"\n}"}
{"plan_idx": 415, "title": "no-sugar-rock-cakes", "question_idx": 415, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 9 because the rock cakes need to be baked before they can be removed and placed on a cooling tray.\"\n}"}
{"plan_idx": 416, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 416, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 15], "binary_question": "Must Step 9 happen before Step 16?", "why_question": "Why must Step 9 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 9 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 16 because the shortcakes need to be baked and cooled before assembling the dessert.\"\n}"}
{"plan_idx": 417, "title": "lightly spiced tomato and red lentil soup", "question_idx": 417, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 11], "binary_question": "Must Step 6 happen before Step 12?", "why_question": "Why must Step 6 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 6 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 12 because the soup needs to simmer for 25-30 minutes to soften the lentils and vegetables before being seasoned and served.\"\n}"}
{"plan_idx": 418, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 418, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [13, 14], "binary_question": "Must Step 14 happen before Step 15?", "why_question": "Why must Step 14 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 14 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 must happen before Step 14 because the shortcakes need to be split in half before placing cake bottoms on dessert plates.\"\n}"}
{"plan_idx": 419, "title": "black-rice-pudding", "question_idx": 419, "steps": ["Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.", "Bring to the boil over high heat, stirring frequently.", "Reduce heat to medium-low.", "Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.", "Stir in coconut cream and vanilla extract.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: black-rice-pudding\n\nProcedure:\n1. Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.\n2. Bring to the boil over high heat, stirring frequently.\n3. Reduce heat to medium-low.\n4. Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.\n5. Stir in coconut cream and vanilla extract.\n6. Serve warm.\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to prepare the rice before cooking it in Step 3.\"\n}"}
{"plan_idx": 420, "title": "balsamic-and-mozzarella-chicken", "question_idx": 420, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 2 happen before Step 7?", "why_question": "Why must Step 2 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 2 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the chicken needs to marinate in the vinaigrette before being cooked and topped with mozzarella, basil, and tomato.\"\n}"}
{"plan_idx": 421, "title": "chocolate-pancake-batter", "question_idx": 421, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 2 happen before Step 9?", "why_question": "Why must Step 2 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 2 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 9 because the eggs need to be whisked into the batter before cooking the pancake.\"\n}"}
{"plan_idx": 422, "title": "fusilli-and-meatballs", "question_idx": 422, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 20], "binary_question": "Must Step 2 happen before Step 21?", "why_question": "Why must Step 2 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 2 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 2 does not need to happen before Step 21 because they are independent steps in the procedure.\"\n}"}
{"plan_idx": 423, "title": "chocolate-chocolate-cake", "question_idx": 423, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 17], "binary_question": "Must Step 10 happen before Step 18?", "why_question": "Why must Step 10 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the cooled chocolate needs to be added to the mixture before baking the cake.\"\n}"}
{"plan_idx": 424, "title": "spicy-tomato-anchovy-pasta", "question_idx": 424, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 4 because the anchovies and water need time to simmer and infuse the flavors before adding the spring onions, tomatoes, and parsley.\"\n}"}
{"plan_idx": 425, "title": "brown sugar shortbread", "question_idx": 425, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 3 happen before Step 8?", "why_question": "Why must Step 3 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 3 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 8 because the dough needs to be prepared before it can be rolled and cut into strips.\"\n}"}
{"plan_idx": 426, "title": "brown sugar shortbread", "question_idx": 426, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the flour needs to be added before kneading the dough.\"\n}"}
{"plan_idx": 427, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 427, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 5 because the onions need to be softened before adding the other ingredients.\"\n}"}
{"plan_idx": 428, "title": "lightly spiced tomato and red lentil soup", "question_idx": 428, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 6 because the vegetables need to be cooked before simmering the soup.\"\n}"}
{"plan_idx": 429, "title": "creamy-chayote-squash-soup", "question_idx": 429, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 6 happen before Step 9?", "why_question": "Why must Step 6 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 6 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 9 because the soup needs to simmer for 20 minutes before being pureed and served.\"\n}"}
{"plan_idx": 430, "title": "chocolate-pancake-batter", "question_idx": 430, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 7 happen before Step 11?", "why_question": "Why must Step 7 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 7 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen after Step 7, but it does not have to happen immediately after Step 7.\"\n}"}
{"plan_idx": 431, "title": "one-pot irish stew", "question_idx": 431, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 7 because it is the step where the stew is thickened and seasoned before serving.\"\n}"}
{"plan_idx": 432, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 432, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 9 because the dough needs to be prepared and baked before the shortcakes can be assembled.\"\n}"}
{"plan_idx": 433, "title": "chocolate-pancake-batter", "question_idx": 433, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 2 happen before Step 7?", "why_question": "Why must Step 2 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 2 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 7 because the eggs need to be whisked into the flour and cocoa powder before adding the other ingredients to create the batter.\"\n}"}
{"plan_idx": 434, "title": "white bread", "question_idx": 434, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 11], "binary_question": "Must Step 10 happen before Step 12?", "why_question": "Why must Step 10 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 10 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 must happen before Step 12 because the dough needs to be shaped into loaves before allowing it to rise further in the tins.\"\n}"}
{"plan_idx": 435, "title": "spiced butternut squash soup", "question_idx": 435, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [13, 16], "binary_question": "Must Step 14 happen before Step 17?", "why_question": "Why must Step 14 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 14 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 14 does not need to happen before Step 17 because the soup can be seasoned after ladling into bowls.\"\n}"}
{"plan_idx": 436, "title": "chicken-prawn-and-rice-soup", "question_idx": 436, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 1 happen before Step 9?", "why_question": "Why must Step 1 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 1 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 9 because the mixture prepared in Step 1 needs to be added to the pot before the soup is allowed to simmer in Step 9.\"\n}"}
{"plan_idx": 437, "title": "curried bbq mussels", "question_idx": 437, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the curry mixture needs to be added before the red pepper, parsley, and lime slices.\"\n}"}
{"plan_idx": 438, "title": "very-vanilla-ry-cheesecake", "question_idx": 438, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The mixture needs to be poured into the biscuit base before baking, so Step 8 must happen before Step 9.\"\n}"}
{"plan_idx": 439, "title": "very-vanilla-ry-cheesecake", "question_idx": 439, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 6 happen before Step 9?", "why_question": "Why must Step 6 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 6 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cream cheese mixture needs to be prepared before pouring it into the biscuit base.\"\n}"}
{"plan_idx": 440, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 440, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 2 happen before Step 9?", "why_question": "Why must Step 2 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 2 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 9 because the dough needs to be prepared and baked before the strawberries and whipped cream are added.\"\n}"}
{"plan_idx": 441, "title": "balsamic-and-mozzarella-chicken", "question_idx": 441, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 9 happen before Step 10?", "why_question": "Why must Step 9 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 9 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 10 because the balsamic vinegar needs to be drizzled over the platter before seasoning with salt and pepper.\" \n}"}
{"plan_idx": 442, "title": "one-pot irish stew", "question_idx": 442, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 6 because the stew needs to simmer and cook before it can be seasoned and served.\"\n}"}
{"plan_idx": 443, "title": "chocolate-chocolate-cake", "question_idx": 443, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 16], "binary_question": "Must Step 8 happen before Step 17?", "why_question": "Why must Step 8 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The egg yolks need to be gradually beaten in before baking the cake.\"\n}"}
{"plan_idx": 444, "title": "apple-pumpkin-spread", "question_idx": 444, "steps": ["In a medium saucepan over medium heat, mix pumpkin puree, apple sauce, apple juice, dark brown soft sugar and spices.", "Bring mixture to the boil.", "Reduce heat and simmer approximately 1 1/2 hours.", "Transfer to sterile containers and chill in the refrigerator until serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: apple-pumpkin-spread\n\nProcedure:\n1. In a medium saucepan over medium heat, mix pumpkin puree, apple sauce, apple juice, dark brown soft sugar and spices.\n2. Bring mixture to the boil.\n3. Reduce heat and simmer approximately 1 1/2 hours.\n4. Transfer to sterile containers and chill in the refrigerator until serving.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can happen after Step 2, but it is not required to happen immediately after Step 2. The mixture can be chilled in the refrigerator at a later time.\"\n}"}
{"plan_idx": 445, "title": "no-sugar-rock-cakes", "question_idx": 445, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 8 because the dough needs to be formed into balls and placed on the baking tray before baking.\" \n}"}
{"plan_idx": 446, "title": "chicken and vegetable pie", "question_idx": 446, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 13], "binary_question": "Must Step 13 happen before Step 14?", "why_question": "Why must Step 13 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 13 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 13 must happen before Step 14 because the pastry needs to be sealed and excess cut away before making slits for steam to escape.\"\n}"}
{"plan_idx": 447, "title": "almond and apple cake", "question_idx": 447, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 6 because the eggs need to be beaten well before adding the ground almonds.\"\n}"}
{"plan_idx": 448, "title": "fusilli-and-meatballs", "question_idx": 448, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 1 happen before Step 13?", "why_question": "Why must Step 1 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 1 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The onion mixture from Step 1 is needed to mix with the beef and other ingredients in Step 12 to form the meatballs in Step 13.\"\n}"}
{"plan_idx": 449, "title": "chocolate-chocolate-cake", "question_idx": 449, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 8 happen before Step 13?", "why_question": "Why must Step 8 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The egg yolks need to be beaten into the mixture before the egg whites are folded in.\"\n}"}
{"plan_idx": 450, "title": "tortellini-fritto-with-almond-butter", "question_idx": 450, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 1 happen before Step 5?", "why_question": "Why must Step 1 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 1 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 5 because the tortellini needs to be cooked before it can be fried and mixed with almond butter.\"\n}"}
{"plan_idx": 451, "title": "chocolate-pancake-batter", "question_idx": 451, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 allows the batter to rest and develop flavor, which is important before cooking the pancakes in Step 9.\"\n}"}
{"plan_idx": 452, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 452, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 15], "binary_question": "Must Step 1 happen before Step 16?", "why_question": "Why must Step 1 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 1 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 16 because the strawberries need to be refrigerated until serving, and they are used as a topping in Step 16.\"\n}"}
{"plan_idx": 453, "title": "chocolate-chocolate-cake", "question_idx": 453, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 17], "binary_question": "Must Step 5 happen before Step 18?", "why_question": "Why must Step 5 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 5 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 needs to happen before Step 18 because the chocolate mixture needs to cool before the cake is baked.\"\n}"}
{"plan_idx": 454, "title": "cranachan", "question_idx": 454, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 2 happen before Step 10?", "why_question": "Why must Step 2 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 2 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 10 because the oats need to be toasted and cooled before being used as a garnish.\"\n}"}
{"plan_idx": 455, "title": "chicken-prawn-and-rice-soup", "question_idx": 455, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 8 happen before Step 13?", "why_question": "Why must Step 8 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 8 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen before Step 8 as long as the soup is fully cooked and ready to be served.\"\n}"}
{"plan_idx": 456, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 456, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [13, 15], "binary_question": "Must Step 14 happen before Step 16?", "why_question": "Why must Step 14 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 14 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 14 must happen before Step 16 because the shortcakes need to be split in half before assembling them with the lemon butter, strawberries, and whipped cream.\"\n}"}
{"plan_idx": 457, "title": "curried bbq mussels", "question_idx": 457, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 3 happen before Step 10?", "why_question": "Why must Step 3 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 3 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 can happen before Step 3 if the mussels have opened before the packets are fully cooked.\"\n}"}
{"plan_idx": 458, "title": "chocolate-chocolate-cake", "question_idx": 458, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 20], "binary_question": "Must Step 10 happen before Step 21?", "why_question": "Why must Step 10 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the cake needs to cool completely before adding icing sugar for decoration.\"\n}"}
{"plan_idx": 459, "title": "slow cooker butter chicken", "question_idx": 459, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 5 because the ingredients need to be cooked and combined before transferring to the slow cooker.\"\n}"}
{"plan_idx": 460, "title": "chicken and vegetable pie", "question_idx": 460, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 15], "binary_question": "Must Step 13 happen before Step 16?", "why_question": "Why must Step 13 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 13 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 13 must happen before Step 16 because the pie needs to be baked before it can be cooled and served.\"\n}"}
{"plan_idx": 461, "title": "one-pot irish stew", "question_idx": 461, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 6 because the stew needs to be fully cooked before seasoning.\" \n}"}
{"plan_idx": 462, "title": "black-rice-pudding", "question_idx": 462, "steps": ["Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.", "Bring to the boil over high heat, stirring frequently.", "Reduce heat to medium-low.", "Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.", "Stir in coconut cream and vanilla extract.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: black-rice-pudding\n\nProcedure:\n1. Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.\n2. Bring to the boil over high heat, stirring frequently.\n3. Reduce heat to medium-low.\n4. Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.\n5. Stir in coconut cream and vanilla extract.\n6. Serve warm.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 5 because the rice needs to be cooked before adding the coconut cream and vanilla extract.\"\n}"}
{"plan_idx": 463, "title": "vegetable-terrine", "question_idx": 463, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 13], "binary_question": "Must Step 6 happen before Step 14?", "why_question": "Why must Step 6 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 6 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cream mixture needs to be poured into the mould before refrigerating and serving, so Step 6 must happen before Step 14.\"\n}"}
{"plan_idx": 464, "title": "chocolate-chocolate-cake", "question_idx": 464, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 16], "binary_question": "Must Step 4 happen before Step 17?", "why_question": "Why must Step 4 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 4 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not need to happen before Step 17 because Step 4 involves setting aside the chocolate mixture to cool, while Step 17 involves baking the cake in the oven.\"\n}"}
{"plan_idx": 465, "title": "spiced-pumpkin-teabread", "question_idx": 465, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 6 happen before Step 13?", "why_question": "Why must Step 6 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 6 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen after Step 6, as it is not dependent on the order of the previous steps.\"\n}"}
{"plan_idx": 466, "title": "fusilli-and-meatballs", "question_idx": 466, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 17], "binary_question": "Must Step 3 happen before Step 18?", "why_question": "Why must Step 3 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 3 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be shaped and cooked before being added to the tomato sauce in Step 17.\"\n}"}
{"plan_idx": 467, "title": "fusilli-and-meatballs", "question_idx": 467, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 1 happen before Step 12?", "why_question": "Why must Step 1 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 1 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The onion mixture needs to be saut\u00e9ed before adding the other ingredients for the meatballs.\"\n}"}
{"plan_idx": 468, "title": "chocolate-chocolate-cake", "question_idx": 468, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 16], "binary_question": "Must Step 10 happen before Step 17?", "why_question": "Why must Step 10 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cooled chocolate mixture needs to be added to the cake tin before baking in Step 17.\"\n}"}
{"plan_idx": 469, "title": "fusilli-and-meatballs", "question_idx": 469, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 16], "binary_question": "Must Step 7 happen before Step 17?", "why_question": "Why must Step 7 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 7 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be cooked before being added to the tomato sauce.\"\n}"}
{"plan_idx": 470, "title": "spiced-pumpkin-teabread", "question_idx": 470, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 1 happen before Step 11?", "why_question": "Why must Step 1 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 1 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 11 because the oven needs to be preheated before baking the teabread.\"\n}"}
{"plan_idx": 471, "title": "spiced-pumpkin-teabread", "question_idx": 471, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The pumpkin mixture needs to be evenly mixed before being transferred to the tin.\"\n}"}
{"plan_idx": 472, "title": "chocolate-chocolate-cake", "question_idx": 472, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 4 happen before Step 13?", "why_question": "Why must Step 4 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 4 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the chocolate mixture needs to be cooled before being folded into the egg white mixture.\"\n}"}
{"plan_idx": 473, "title": "very-vanilla-ry-cheesecake", "question_idx": 473, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 7 happen before Step 9?", "why_question": "Why must Step 7 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 7 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The eggs need to be fully incorporated into the cream cheese mixture before pouring it into the biscuit base.\"\n}"}
{"plan_idx": 474, "title": "chocolate-chocolate-cake", "question_idx": 474, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 16], "binary_question": "Must Step 5 happen before Step 17?", "why_question": "Why must Step 5 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 5 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chocolate mixture needs to cool before pouring it into the cake tin and baking.\"\n}"}
{"plan_idx": 475, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 475, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 6 because the onions need to be softened before adding the other ingredients and creating the sauce.\"\n}"}
{"plan_idx": 476, "title": "creamy-chayote-squash-soup", "question_idx": 476, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 3 because the butter needs to be melted before adding the onion, garlic, and crushed chillies to cook and stir.\" \n}"}
{"plan_idx": 477, "title": "banana-split-cake", "question_idx": 477, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 7 happen before Step 9?", "why_question": "Why must Step 7 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 7 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 9 happens before Step 7 because the bananas and pineapple need to be arranged on the filling before spreading the mixture from Step 7 over the base.\"\n}"}
{"plan_idx": 478, "title": "best-ever-margarita", "question_idx": 478, "steps": ["Rim 2 margarita glasses with salt if desired and fill with ice.", "Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.", "Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.", "Pour into prepared margarita glasses and serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: best-ever-margarita\n\nProcedure:\n1. Rim 2 margarita glasses with salt if desired and fill with ice.\n2. Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.\n3. Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.\n4. Pour into prepared margarita glasses and serve.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 4 because the ingredients need to be mixed in the cocktail shaker before being poured into the glasses.\"\n}"}
{"plan_idx": 479, "title": "tomato and basil salad", "question_idx": 479, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not need to happen before Step 5 because covering with cling film can happen after all the ingredients are added to the plate.\"\n}"}
{"plan_idx": 480, "title": "chocolate-chocolate-cake", "question_idx": 480, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 16], "binary_question": "Must Step 7 happen before Step 17?", "why_question": "Why must Step 7 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 7 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The mixture needs to be prepared before baking the cake.\"\n}"}
{"plan_idx": 481, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 481, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 needs to happen before Step 5 because the tomatoes need to be drained before being mixed with the lentils.\"\n}"}
{"plan_idx": 482, "title": "spiced butternut squash soup", "question_idx": 482, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 15], "binary_question": "Must Step 12 happen before Step 16?", "why_question": "Why must Step 12 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 12 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the soup needs to be pureed before it is heated through.\"\n}"}
{"plan_idx": 483, "title": "banana-split-cake", "question_idx": 483, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 1 happen before Step 8?", "why_question": "Why must Step 1 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 1 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 8 because the base needs to be baked and cooled before the filling is spread over it.\"\n}"}
{"plan_idx": 484, "title": "spiced butternut squash soup", "question_idx": 484, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 13], "binary_question": "Must Step 8 happen before Step 14?", "why_question": "Why must Step 8 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 8 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 needs to happen before Step 14 because the onions, leeks, and garlic need to be saut\u00e9ed before the soup is seasoned and heated through.\"\n}"}
{"plan_idx": 485, "title": "spiced butternut squash soup", "question_idx": 485, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 3 happen before Step 12?", "why_question": "Why must Step 3 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 3 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be baked and cooled before it can be added to the soup and mashed with the potatoes.\"\n}"}
{"plan_idx": 486, "title": "spiced-pumpkin-teabread", "question_idx": 486, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 3 happen before Step 12?", "why_question": "Why must Step 3 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 3 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The pumpkin needs to be cooked and mashed before the teabread can be baked.\"\n}"}
{"plan_idx": 487, "title": "fusilli-and-meatballs", "question_idx": 487, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tomatoes need to be processed before being brought to a boil in the saucepan.\"\n}"}
{"plan_idx": 488, "title": "spiced butternut squash soup", "question_idx": 488, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 14], "binary_question": "Must Step 1 happen before Step 15?", "why_question": "Why must Step 1 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 1 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 15 because the oven needs to be preheated before the soup is seasoned and heated through.\"\n}"}
{"plan_idx": 489, "title": "white bread", "question_idx": 489, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, step 4 must happen before step 8 because the dough needs to rise and double in bulk before it can be punched down and allowed to rise again.\"\n}"}
{"plan_idx": 490, "title": "lightly spiced tomato and red lentil soup", "question_idx": 490, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 3 happen before Step 12?", "why_question": "Why must Step 3 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 3 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 12 because the vegetables need to be cooked before serving the soup.\"\n}"}
{"plan_idx": 491, "title": "almond and apple cake", "question_idx": 491, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 7 happen before Step 8?", "why_question": "Why must Step 7 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 7 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The flour and milk need to be added in two separate stages to ensure they are well combined with the other ingredients.\"\n}"}
{"plan_idx": 492, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 492, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 4 because the butter needs to be rubbed into the flour before the milk, egg yolk, and lemon zest are added to the mixture.\"\n}"}
{"plan_idx": 493, "title": "strawberry-tiramisu-trifle", "question_idx": 493, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 4 happen before Step 7?", "why_question": "Why must Step 4 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 4 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The soaked sponge fingers need to be lined in the glass bowl before adding the strawberries, grated chocolate, and custard mixture in order to create the layers of the trifle.\"\n}"}
{"plan_idx": 494, "title": "strawberries-in-pimm-s", "question_idx": 494, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the strawberries need to stand at room temperature for 15 minutes before adding the Pimm's.\"\n}"}
{"plan_idx": 495, "title": "jam-drop-biscuits", "question_idx": 495, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 3 because the dough needs to be chilled for at least 30 minutes before forming the biscuits.\" \n}"}
{"plan_idx": 496, "title": "vegetable-terrine", "question_idx": 496, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 5 happen before Step 14?", "why_question": "Why must Step 5 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 needs to happen before Step 14 because the cream mixture needs to be poured into the mould before refrigerating and setting.\" \n}"}
{"plan_idx": 497, "title": "creamy-chayote-squash-soup", "question_idx": 497, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 2 happen before Step 7?", "why_question": "Why must Step 2 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 2 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 7 because the butter needs to be melted and the onion, garlic, and crushed chillies need to be cooked before the squash and stock are added and simmered.\" \n}"}
{"plan_idx": 498, "title": "chocolate-pancake-batter", "question_idx": 498, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 1 happen before Step 4?", "why_question": "Why must Step 1 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 1 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 4 because the batter needs to rest for 20 minutes before cooking the pancakes.\"\n}"}
{"plan_idx": 499, "title": "chocolate-pancake-batter", "question_idx": 499, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 1 happen before Step 10?", "why_question": "Why must Step 1 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 1 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 10 because the batter needs to be prepared before cooking the pancakes.\"\n}"}
{"plan_idx": 500, "title": "shellabina-s-corned-beef-hash", "question_idx": 500, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 5 because the stew needs to simmer for 20 minutes before adding the corned beef and then allowing it to thicken up.\"\n}"}
{"plan_idx": 501, "title": "spiced butternut squash soup", "question_idx": 501, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 1 happen before Step 13?", "why_question": "Why must Step 1 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 1 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be baked and cooled before it can be pureed in Step 13.\"\n}"}
{"plan_idx": 502, "title": "chocolate-chocolate-cake", "question_idx": 502, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 21], "binary_question": "Must Step 13 happen before Step 22?", "why_question": "Why must Step 13 happen before Step 22?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 13 happen before Step 22?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, step 13 does not need to happen before step 22 because step 22 is a decoration step that can be done after the cake has cooled completely.\"\n}"}
{"plan_idx": 503, "title": "slow cooker butter chicken", "question_idx": 503, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to heat the butter and oil before adding the chicken, onion, and garlic in Step 2.\"\n}"}
{"plan_idx": 504, "title": "curried bbq mussels", "question_idx": 504, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 6 happen before Step 9?", "why_question": "Why must Step 6 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 6 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 6 must happen before Step 9 because the curry mixture, red pepper, and parsley need to be added to the mussels before they are cooked in the foil packets.\"\n}"}
{"plan_idx": 505, "title": "almond and apple cake", "question_idx": 505, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 3 happen before Step 12?", "why_question": "Why must Step 3 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 3 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 12 because the baking parchment needs to be in place before the cake is baked.\"\n}"}
{"plan_idx": 506, "title": "tortellini-fritto-with-almond-butter", "question_idx": 506, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 1 happen before Step 6?", "why_question": "Why must Step 1 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 1 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 6 because the tortellini needs to be cooked before it can be fried and mixed with almond butter.\"\n}"}
{"plan_idx": 507, "title": "brown sugar shortbread", "question_idx": 507, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 6 because the dough needs to be kneaded on a floured surface to prevent sticking.\"\n}"}
{"plan_idx": 508, "title": "almond and apple cake", "question_idx": 508, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 6 happen before Step 11?", "why_question": "Why must Step 6 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 6 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The ground almonds need to be stirred in before the mixture is spooned into the tin.\"\n}"}
{"plan_idx": 509, "title": "strawberry-tiramisu-trifle", "question_idx": 509, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The custard mixture needs to be added before the layers are repeated.\"\n}"}
{"plan_idx": 510, "title": "curried bbq mussels", "question_idx": 510, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 3 happen before Step 8?", "why_question": "Why must Step 3 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 3 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 8 because the mussels need to be divided into portions and wrapped in foil before cooking on the barbecue.\"\n}"}
{"plan_idx": 511, "title": "strawberries-in-pimm-s", "question_idx": 511, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 6 because the strawberries need to soak in the Pimm's for 30 minutes before garnishing with mint leaves.\"\n}"}
{"plan_idx": 512, "title": "lightly spiced tomato and red lentil soup", "question_idx": 512, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 9 happen before Step 10?", "why_question": "Why must Step 9 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 9 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Blending the soup in step 9 will affect the consistency, so it needs to happen before checking and adjusting the consistency in step 10.\"\n}"}
{"plan_idx": 513, "title": "spiced butternut squash soup", "question_idx": 513, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 4 happen before Step 12?", "why_question": "Why must Step 4 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 4 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The squash needs to be baked and softened before it can be mashed with the potatoes in Step 12.\"\n}"}
{"plan_idx": 514, "title": "chocolate-chocolate-cake", "question_idx": 514, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [16, 21], "binary_question": "Must Step 17 happen before Step 22?", "why_question": "Why must Step 17 happen before Step 22?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen before Step 22?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cake needs to cool completely before adding the icing sugar for decoration.\"\n}"}
{"plan_idx": 515, "title": "brown sugar shortbread", "question_idx": 515, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 4 happen before Step 7?", "why_question": "Why must Step 4 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 4 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 7 because the dough needs to be mixed well before rolling it out to the desired thickness.\"\n}"}
{"plan_idx": 516, "title": "spiced-pumpkin-teabread", "question_idx": 516, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 7 happen before Step 12?", "why_question": "Why must Step 7 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 7 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 12 because the loaf needs to be baked before it can be allowed to cool in the tin.\"\n}"}
{"plan_idx": 517, "title": "banana-split-cake", "question_idx": 517, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 2 happen before Step 9?", "why_question": "Why must Step 2 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 2 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 9 because the base needs to be prepared before adding the bananas and pineapple.\"\n}"}
{"plan_idx": 518, "title": "simple-basic-cupcakes", "question_idx": 518, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 8 because the flour needs to be mixed well into the batter before baking to ensure the cupcakes are evenly cooked.\"\n}"}
{"plan_idx": 519, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 519, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 9 happen before Step 10?", "why_question": "Why must Step 9 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 9 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 10 because the tuna and parsley need to be mixed in with the peppers and mushrooms before serving.\"\n}"}
{"plan_idx": 520, "title": "no-sugar-rock-cakes", "question_idx": 520, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 1 happen before Step 8?", "why_question": "Why must Step 1 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 1 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 8 because the oven needs to be preheated before baking the rock cakes.\"\n}"}
{"plan_idx": 521, "title": "easy strawberry tart", "question_idx": 521, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 6 because the mixture needs to be removed from heat before it can be poured into the base and chilled.\"\n}"}
{"plan_idx": 522, "title": "cranachan", "question_idx": 522, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 2 happen before Step 7?", "why_question": "Why must Step 2 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 2 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Toasted oats need to be cooled before folding into the whipped cream.\"\n}"}
{"plan_idx": 523, "title": "fiery-bean-and-avocado-dip", "question_idx": 523, "steps": ["In a large bowl, mix blackeyed beans, tomatoes, red onion, Scotch bonnet chillies, Italian dressing and cayenne pepper.", "Stir in the avocados just before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fiery-bean-and-avocado-dip\n\nProcedure:\n1. In a large bowl, mix blackeyed beans, tomatoes, red onion, Scotch bonnet chillies, Italian dressing and cayenne pepper.\n2. Stir in the avocados just before serving.\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the avocados should be added just before serving to prevent them from browning.\" \n}"}
{"plan_idx": 524, "title": "cranachan", "question_idx": 524, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 2 happen before Step 8?", "why_question": "Why must Step 2 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 2 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 8 because the toasted oats are folded into the whipped cream mixture before spooning into serving bowls.\"\n}"}
{"plan_idx": 525, "title": "spicy-tomato-anchovy-pasta", "question_idx": 525, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 2 happen before Step 8?", "why_question": "Why must Step 2 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 2 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 8 because the linguine needs to be cooked and drained before being tossed with the anchovy mixture.\"\n}"}
{"plan_idx": 526, "title": "spiced-pumpkin-teabread", "question_idx": 526, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 3 happen before Step 10?", "why_question": "Why must Step 3 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 3 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The pumpkin seeds need to be sprinkled on the loaf before baking, so the pumpkin flesh needs to be steamed or cooked before that step.\"\n}"}
{"plan_idx": 527, "title": "cranachan", "question_idx": 527, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 3 because the oats need to be spread out before toasting in the oven.\"\n}"}
{"plan_idx": 528, "title": "chicken and vegetable pie", "question_idx": 528, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 14], "binary_question": "Must Step 10 happen before Step 15?", "why_question": "Why must Step 10 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 10 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 10 must happen before Step 15 because the pie dish needs to be prepared before baking the pie.\"\n}"}
{"plan_idx": 529, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 529, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 14], "binary_question": "Must Step 5 happen before Step 15?", "why_question": "Why must Step 5 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 5 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 15 because the dough needs to be prepared and baked before assembling the shortcakes.\"\n}"}
{"plan_idx": 530, "title": "chicken and vegetable pie", "question_idx": 530, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 12], "binary_question": "Must Step 11 happen before Step 13?", "why_question": "Why must Step 11 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 11 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 11 must happen before Step 13 because the chicken mixture needs to be in the pie dish before covering it with the top pastry.\"\n}"}
{"plan_idx": 531, "title": "tangy-gammon-in-cider", "question_idx": 531, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tomatoes need to be prepared before cooking for 1 hour in Step 9.\"\n}"}
{"plan_idx": 532, "title": "curried bbq mussels", "question_idx": 532, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 4 happen before Step 10?", "why_question": "Why must Step 4 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 4 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 10 because the mussels need to be divided and prepared before cooking, and any mussels that do not open during cooking need to be discarded.\"\n}"}
{"plan_idx": 533, "title": "fusilli-and-meatballs", "question_idx": 533, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 3 because the onion mixture from Step 1 is used in Step 3.\"\n}"}
{"plan_idx": 534, "title": "chocolate-pancake-batter", "question_idx": 534, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 6 happen before Step 9?", "why_question": "Why must Step 6 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 6 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 9 because the pan needs to be greased before flipping the pancake.\"\n}"}
{"plan_idx": 535, "title": "tortellini-fritto-with-almond-butter", "question_idx": 535, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 7 because the tortellini needs to be fried until golden brown before serving.\"\n}"}
{"plan_idx": 536, "title": "very-vanilla-ry-cheesecake", "question_idx": 536, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 1 happen before Step 13?", "why_question": "Why must Step 1 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 1 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 13 because the oven needs to be preheated before the cheesecake is baked, and then the cheesecake needs to cool down inside the oven before being refrigerated.\"\n}"}
{"plan_idx": 537, "title": "fusilli-and-meatballs", "question_idx": 537, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 15], "binary_question": "Must Step 4 happen before Step 16?", "why_question": "Why must Step 4 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 4 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not need to happen before Step 16 because they are independent of each other.\"\n}"}
{"plan_idx": 538, "title": "busters-liver-dinner", "question_idx": 538, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 can happen before Step 5 as the meals can be microwaved directly from the slow cooker without dividing and storing in tubs.\"\n}"}
{"plan_idx": 539, "title": "fusilli-and-meatballs", "question_idx": 539, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 16], "binary_question": "Must Step 6 happen before Step 17?", "why_question": "Why must Step 6 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 6 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tomatoes need to be processed and added to the saucepan before the meatballs are added to the tomato sauce.\"\n}"}
{"plan_idx": 540, "title": "almond and apple cake", "question_idx": 540, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 12], "binary_question": "Must Step 7 happen before Step 13?", "why_question": "Why must Step 7 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 7 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen before Step 7 because the cake needs to cool slightly before being turned onto a serving plate.\"\n}"}
{"plan_idx": 541, "title": "chicken-prawn-and-rice-soup", "question_idx": 541, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 3 happen before Step 8?", "why_question": "Why must Step 3 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 3 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 8 because the prawns and chicken mixture needs to be cooked before adding salt and sherry and returning to the boil.\"\n}"}
{"plan_idx": 542, "title": "spiced-pumpkin-teabread", "question_idx": 542, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 8 happen before Step 11?", "why_question": "Why must Step 8 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 8 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the pumpkin mixture needs to be evenly mixed with the flour and butter before baking.\"\n}"}
{"plan_idx": 543, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 543, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 needs to happen before Step 6 because the lentils and tomatoes need to be mixed together before being distributed into individual bowls or ramekins.\"\n}"}
{"plan_idx": 544, "title": "cranachan", "question_idx": 544, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Whipping the cream to firm peaks before folding in the other ingredients ensures a light and fluffy texture for the cranachan.\"\n}"}
{"plan_idx": 545, "title": "tomato and basil salad", "question_idx": 545, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 1 happen before Step 3?", "why_question": "Why must Step 1 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 1 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 can happen before Step 1 as slicing the tomatoes and scattering them onto the plate does not depend on having the serving plate ready.\"\n}"}
{"plan_idx": 546, "title": "white bread", "question_idx": 546, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 5 happen before Step 11?", "why_question": "Why must Step 5 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 5 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The dough needs to be kneaded and smooth before shaping into loaves.\"\n}"}
{"plan_idx": 547, "title": "chocolate-chocolate-cake", "question_idx": 547, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 6 happen before Step 9?", "why_question": "Why must Step 6 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 9 because the butter and margarine need to be beaten together before gradually adding the flour.\"\n}"}
{"plan_idx": 548, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 548, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 13], "binary_question": "Must Step 8 happen before Step 14?", "why_question": "Why must Step 8 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 8 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The shortcakes need to be baked before they can be split in half and assembled with the strawberries and whipped cream.\"\n}"}
{"plan_idx": 549, "title": "chicken-prawn-and-rice-soup", "question_idx": 549, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 1 happen before Step 7?", "why_question": "Why must Step 1 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 1 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to prepare the prawns and chicken before adding them to the soup in Step 5.\"\n}"}
{"plan_idx": 550, "title": "vegetable-terrine", "question_idx": 550, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 11 happen before Step 12?", "why_question": "Why must Step 11 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 11 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the vegetables need to be arranged before pouring the remaining cream mixture on top.\"\n}"}
{"plan_idx": 551, "title": "spiced butternut squash soup", "question_idx": 551, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 6 because the squash needs to be baked and cooled before peeling and setting aside.\" \n}"}
{"plan_idx": 552, "title": "almond and apple cake", "question_idx": 552, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 8 happen before Step 12?", "why_question": "Why must Step 8 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The flour and milk need to be added before baking the cake.\"\n}"}
{"plan_idx": 553, "title": "white bread", "question_idx": 553, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 3 happen before Step 8?", "why_question": "Why must Step 3 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 3 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 8 must happen before Step 3 because the dough needs to rise before it is punched down and then mixed with salt and oil.\"\n}"}
{"plan_idx": 554, "title": "tomato and basil salad", "question_idx": 554, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 2 because the serving plate needs to be prepared before the tomatoes are sliced and placed on it.\"\n}"}
{"plan_idx": 555, "title": "almond and apple cake", "question_idx": 555, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 6 happen before Step 13?", "why_question": "Why must Step 6 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 6 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cake needs to cool slightly in the pan before being turned out onto a serving plate.\"\n}"}
{"plan_idx": 556, "title": "strawberries-in-pimm-s", "question_idx": 556, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 3 must happen before Step 5 because the strawberries need to stand at room temperature for 15 minutes before adding the Pimm's and then standing for another 30 minutes.\"\n}"}
{"plan_idx": 557, "title": "spiced-pumpkin-teabread", "question_idx": 557, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 5 happen before Step 10?", "why_question": "Why must Step 5 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 5 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The pumpkin seeds need to be sprinkled on top before baking, so Step 5 must happen before Step 10.\"\n}"}
{"plan_idx": 558, "title": "lightly spiced tomato and red lentil soup", "question_idx": 558, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 9 because the spices need to be cooked with the vegetables before blending the soup.\"\n}"}
{"plan_idx": 559, "title": "curried bbq mussels", "question_idx": 559, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 1 happen before Step 9?", "why_question": "Why must Step 1 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 1 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 9 because it is necessary to preheat the barbecue before cooking the mussels.\"\n}"}
{"plan_idx": 560, "title": "strawberries-in-pimm-s", "question_idx": 560, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the strawberries need to be coated with sugar before adding the Pimm's and letting it stand for 30 minutes.\"\n}"}
{"plan_idx": 561, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 561, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 7 happen before Step 9?", "why_question": "Why must Step 7 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 7 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 9 because the peppers need to be mixed into the mushrooms before adding the tuna and parsley.\"\n}"}
{"plan_idx": 562, "title": "fusilli-and-meatballs", "question_idx": 562, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The tomatoes need to be processed before being brought to a boil in the saucepan.\"\n}"}
{"plan_idx": 563, "title": "fusilli-and-meatballs", "question_idx": 563, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 12], "binary_question": "Must Step 3 happen before Step 13?", "why_question": "Why must Step 3 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 3 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 13 because the onion mixture is needed to mix with the other ingredients to form the meatballs.\"\n}"}
{"plan_idx": 564, "title": "chocolate-pancake-batter", "question_idx": 564, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Whisking in the beaten eggs before gradually whisking in the milk, melted butter, and sugar allows for better incorporation of the wet ingredients into the dry ingredients.\"\n}"}
{"plan_idx": 565, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 565, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 2 happen before Step 7?", "why_question": "Why must Step 2 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 2 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 7 because the grapefruit juice from the bowl is needed to mix with the cracked peppercorns in Step 7.\"\n}"}
{"plan_idx": 566, "title": "strawberries-in-pimm-s", "question_idx": 566, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 1 happen before Step 5?", "why_question": "Why must Step 1 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 1 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 5 because the strawberries need to be prepared and coated with sugar before adding the Pimm's and letting it stand.\"\n}"}
{"plan_idx": 567, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 567, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 needs to happen before Step 8 because the mushrooms need to give up their juices before adding the roasted red peppers.\"\n}"}
{"plan_idx": 568, "title": "white bread", "question_idx": 568, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 4 happen before Step 10?", "why_question": "Why must Step 4 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 4 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 10 because the dough needs to be properly kneaded before it is divided and shaped into loaves.\"\n}"}
{"plan_idx": 569, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 569, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 15], "binary_question": "Must Step 8 happen before Step 16?", "why_question": "Why must Step 8 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 8 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The shortcakes need to be baked before they can be assembled with the strawberries and whipped cream.\"\n}"}
{"plan_idx": 570, "title": "vegetable-terrine", "question_idx": 570, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 14], "binary_question": "Must Step 1 happen before Step 15?", "why_question": "Why must Step 1 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 1 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 15 because the gelatin needs time to soften in the cold water before it can be used in the recipe.\"\n}"}
{"plan_idx": 571, "title": "very-vanilla-ry-cheesecake", "question_idx": 571, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 8 happen before Step 12?", "why_question": "Why must Step 8 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 8 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 12 because the cheesecake needs to be baked before it can be cooled down and refrigerated.\"\n}"}
{"plan_idx": 572, "title": "chocolate-pancake-batter", "question_idx": 572, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Whisking in the beaten eggs before setting the batter aside to rest allows the eggs to be fully incorporated into the mixture.\"\n}"}
{"plan_idx": 573, "title": "chocolate-chocolate-cake", "question_idx": 573, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 16], "binary_question": "Must Step 1 happen before Step 17?", "why_question": "Why must Step 1 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 1 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 17 because the oven needs to be preheated before the cake is baked.\"\n}"}
{"plan_idx": 574, "title": "spiced butternut squash soup", "question_idx": 574, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 9 because the onion, leek, and garlic need to be saut\u00e9ed before adding the chicken stock.\"\n}"}
{"plan_idx": 575, "title": "spiced-pumpkin-teabread", "question_idx": 575, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 4 happen before Step 13?", "why_question": "Why must Step 4 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 4 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 13 because the teabread needs to be brushed with honey while still warm, and the pumpkin mixture needs to be prepared before baking the bread.\"\n}"}
{"plan_idx": 576, "title": "chocolate-chocolate-cake", "question_idx": 576, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [15, 21], "binary_question": "Must Step 16 happen before Step 22?", "why_question": "Why must Step 16 happen before Step 22?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 16 happen before Step 22?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 22 can happen before Step 16, as the cake needs to cool completely before adding icing sugar for decoration.\"\n}"}
{"plan_idx": 577, "title": "white bread", "question_idx": 577, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 3 happen before Step 11?", "why_question": "Why must Step 3 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 3 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 11 because mixing salt and oil into the yeast mixture is necessary before shaping the dough into loaves.\"\n}"}
{"plan_idx": 578, "title": "slow cooker butter chicken", "question_idx": 578, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 4 because the onion needs to soften and turn translucent before adding the curry powder, curry paste, tandoori masala, garam masala, and tomato puree.\"\n}"}
{"plan_idx": 579, "title": "almost no fat banana bread", "question_idx": 579, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 3 must happen before Step 6 because the ingredients need to be mixed and the batter needs to be prepared before baking.\" \n}"}
{"plan_idx": 580, "title": "white bread", "question_idx": 580, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 2 happen before Step 12?", "why_question": "Why must Step 2 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 2 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 2 must happen before Step 12 because allowing the yeast to proof is necessary for the bread to rise properly during the second rising period.\"\n}"}
{"plan_idx": 581, "title": "white bread", "question_idx": 581, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 12], "binary_question": "Must Step 3 happen before Step 13?", "why_question": "Why must Step 3 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 3 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not need to happen before Step 13 because Step 3 involves mixing salt and oil into the yeast mixture, while Step 13 involves baking the bread after it has risen and shaped into loaves.\"\n}"}
{"plan_idx": 582, "title": "chicken-prawn-and-rice-soup", "question_idx": 582, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 12], "binary_question": "Must Step 11 happen before Step 13?", "why_question": "Why must Step 11 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 11 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 13 can happen before Step 11 as the rice can be added to the soup after it has been drained and browned quickly.\" \n}"}
{"plan_idx": 583, "title": "tomato and basil salad", "question_idx": 583, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 3 because the basil leaves are scattered over the sliced tomatoes.\" \n}"}
{"plan_idx": 584, "title": "balsamic-and-mozzarella-chicken", "question_idx": 584, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chicken needs to marinate before it is cooked in the frying pan.\"\n}"}
{"plan_idx": 585, "title": "white bread", "question_idx": 585, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 9 because kneading the dough is part of the process of mixing in the flour and allowing it to rise, which are steps that come before punching the dough down.\"\n}"}
{"plan_idx": 586, "title": "easy strawberry tart", "question_idx": 586, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Boiling for one minute is a necessary step before removing from heat to ensure the mixture is properly cooked.\"\n}"}
{"plan_idx": 587, "title": "banana-split-cake", "question_idx": 587, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 8 happen before Step 11?", "why_question": "Why must Step 8 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 8 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 11 because the whipped cream is used to cover the cake, so it should be the final step.\"\n}"}
{"plan_idx": 588, "title": "cloud-bread", "question_idx": 588, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 needs to happen before Step 7 because the egg whites need to be beaten to stiff peaks before being folded into the cream cheese and egg yolk mixture.\" \n}"}
{"plan_idx": 589, "title": "cranachan", "question_idx": 589, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 3 happen before Step 10?", "why_question": "Why must Step 3 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 3 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 10 because the oats need to be toasted before being used as a garnish in the final step.\"\n}"}
{"plan_idx": 590, "title": "chocolate-chocolate-cake", "question_idx": 590, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 15], "binary_question": "Must Step 11 happen before Step 16?", "why_question": "Why must Step 11 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 11 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The egg whites need to be beaten before being folded into the chocolate mixture, which happens in Step 13 before pouring the mixture into the cake tin in Step 16.\"\n}"}
{"plan_idx": 591, "title": "easy strawberry tart", "question_idx": 591, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 6 because the mixture needs to be boiled and then chilled to set properly.\"\n}"}
{"plan_idx": 592, "title": "curried bbq mussels", "question_idx": 592, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 6 can happen before Step 3 as the order of these steps does not affect the outcome of the recipe.\"\n}"}
{"plan_idx": 593, "title": "spiced butternut squash soup", "question_idx": 593, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 2 happen before Step 12?", "why_question": "Why must Step 2 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 2 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 is necessary to bake the squash before mashing it in Step 12.\"\n}"}
{"plan_idx": 594, "title": "chicken and vegetable pie", "question_idx": 594, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 13], "binary_question": "Must Step 3 happen before Step 14?", "why_question": "Why must Step 3 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 3 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 14 because the chicken mixture needs to be prepared and cooked before being placed in the pie dish and baked.\"\n}"}
{"plan_idx": 595, "title": "strawberry-tiramisu-trifle", "question_idx": 595, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 1 happen before Step 10?", "why_question": "Why must Step 1 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 1 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The strawberries need to be set aside for garnish before the trifle is assembled and refrigerated.\"\n}"}
{"plan_idx": 596, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 596, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 3 happen before Step 10?", "why_question": "Why must Step 3 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 3 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 10 because the lemon zest is used in both steps, and it needs to be incorporated into the dough before being used in the lemon butter.\"\n}"}
{"plan_idx": 597, "title": "chicken-prawn-and-rice-soup", "question_idx": 597, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The prawns and chicken mixture needs to be cooked before draining and adding to the pot with the other ingredients.\"\n}"}
{"plan_idx": 598, "title": "banana-split-cake", "question_idx": 598, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 8 happen before Step 10?", "why_question": "Why must Step 8 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 8 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 10 must happen before Step 8 because the strawberries are layered over the bananas, which are already on the filling in Step 9.\"\n}"}
{"plan_idx": 599, "title": "white bread", "question_idx": 599, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 1 happen before Step 13?", "why_question": "Why must Step 1 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 1 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 13 because it involves dissolving the sugar in warm water and allowing the yeast to proof, which are essential for the bread-making process.\"\n}"}
{"plan_idx": 600, "title": "vegetable-terrine", "question_idx": 600, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 1 happen before Step 8?", "why_question": "Why must Step 1 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 1 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The gelatin needs to be softened before being added to the cream mixture in Step 8.\"\n}"}
{"plan_idx": 601, "title": "banana-split-cake", "question_idx": 601, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 7 because the ingredients need to be combined before beating with an electric mixer.\"\n}"}
{"plan_idx": 602, "title": "chicken and vegetable pie", "question_idx": 602, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 13], "binary_question": "Must Step 2 happen before Step 14?", "why_question": "Why must Step 2 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 2 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 14 because the chicken and vegetable mixture needs to be prepared and placed in the pie dish before baking.\" \n}"}
{"plan_idx": 603, "title": "fusilli-and-meatballs", "question_idx": 603, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 2 happen before Step 12?", "why_question": "Why must Step 2 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 2 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The onion and garlic need to be saut\u00e9ed before being added to the meatball mixture.\"\n}"}
{"plan_idx": 604, "title": "tangy-gammon-in-cider", "question_idx": 604, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 7 because the onions need to be prepared and placed in the casserole dish before the gammon steaks are wrapped and placed in the dish.\"\n}"}
{"plan_idx": 605, "title": "brown sugar shortbread", "question_idx": 605, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 4 must happen before Step 9 because the dough needs to be mixed well before it is rolled out and cut into strips.\" \n}"}
{"plan_idx": 606, "title": "rouille", "question_idx": 606, "steps": ["In a mortar, crush the garlic to a fine mash.", "Transfer to a mixing bowl.", "Add the egg yolks, and beat into a mayonnaise while adding the olive oil.", "When the sauce is thick and smooth, stir in the cayenne pepper and saffron."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 1 happen before Step 4?", "why_question": "Why must Step 1 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: rouille\n\nProcedure:\n1. In a mortar, crush the garlic to a fine mash.\n2. Transfer to a mixing bowl.\n3. Add the egg yolks, and beat into a mayonnaise while adding the olive oil.\n4. When the sauce is thick and smooth, stir in the cayenne pepper and saffron.\n\n\n1. Must Step 1 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 4 because the garlic needs to be crushed and added to the mixing bowl before the other ingredients are incorporated to make the rouille sauce.\"\n}"}
{"plan_idx": 607, "title": "busters-liver-dinner", "question_idx": 607, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 5 because the ingredients need to be cooked before they can be divided into meals and stored.\" \n}"}
{"plan_idx": 608, "title": "spiced butternut squash soup", "question_idx": 608, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 14], "binary_question": "Must Step 3 happen before Step 15?", "why_question": "Why must Step 3 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 3 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 3 must happen before Step 15 because the squash needs to be baked and prepared before it can be seasoned and added to the soup.\"\n}"}
{"plan_idx": 609, "title": "spiced-guava-cake", "question_idx": 609, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 5 happen before Step 6?", "why_question": "Why must Step 5 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 5 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 6 because the creamed butter and sugar need to be prepared before adding the eggs.\"\n}"}
{"plan_idx": 610, "title": "chocolate-chocolate-cake", "question_idx": 610, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [17, 21], "binary_question": "Must Step 18 happen before Step 22?", "why_question": "Why must Step 18 happen before Step 22?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 18 happen before Step 22?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 22 can happen before Step 18 as the cake needs to cool completely before icing sugar is sifted over the top.\"\n}"}
{"plan_idx": 611, "title": "spiced-pumpkin-teabread", "question_idx": 611, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 11 happen before Step 12?", "why_question": "Why must Step 11 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 11 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The teabread needs to cool in the tin for 10 minutes before being turned out onto a wire rack.\"\n}"}
{"plan_idx": 612, "title": "no-sugar-rock-cakes", "question_idx": 612, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 2 happen before Step 7?", "why_question": "Why must Step 2 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 2 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 7 because the baking tray needs to be prepared before placing the dough on it.\"\n}"}
{"plan_idx": 613, "title": "easy strawberry tart", "question_idx": 613, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 5 because the strawberries need to be coated with the mixture before pouring into the base.\"\n}"}
{"plan_idx": 614, "title": "strawberry-tiramisu-trifle", "question_idx": 614, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 7 happen before Step 9?", "why_question": "Why must Step 7 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 7 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 must happen before Step 9 because the strawberries are used in Step 7 and then again in Step 9 for garnishing.\" \n}"}
{"plan_idx": 615, "title": "spanish-rabbit-stew", "question_idx": 615, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 1 happen before Step 10?", "why_question": "Why must Step 1 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 1 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 10 because the ingredients need to be cooked in the slow cooker before being served with pasta.\"\n}"}
{"plan_idx": 616, "title": "spiced-guava-cake", "question_idx": 616, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 4 happen before Step 9?", "why_question": "Why must Step 4 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 4 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 does not need to happen before Step 9 because Step 4 involves mixing the guava pulp and juice, which can be done at any point before adding the batter to the tin.\"\n}"}
{"plan_idx": 617, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 617, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 3 because the onions need to be softened before adding the mushrooms.\"\n}"}
{"plan_idx": 618, "title": "fusilli-and-meatballs", "question_idx": 618, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [13, 16], "binary_question": "Must Step 14 happen before Step 17?", "why_question": "Why must Step 14 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 14 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"The meatballs can be cooked separately and added to the sauce later.\"\n}"}
{"plan_idx": 619, "title": "white bread", "question_idx": 619, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 9 because it allows the dough to rise until doubled in bulk, making it easier to punch down.\"\n}"}
{"plan_idx": 620, "title": "curried bbq mussels", "question_idx": 620, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 5 because the foil is needed to hold the mussels and the curry mixture together while cooking.\"\n}"}
{"plan_idx": 621, "title": "lightly spiced tomato and red lentil soup", "question_idx": 621, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 5 happen before Step 9?", "why_question": "Why must Step 5 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 5 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 9 because the lentils and vegetables need to be cooked before blending the soup.\"\n}"}
{"plan_idx": 622, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 622, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 6 because the mushrooms need to release their juices before adding the other ingredients to create the sauce.\"\n}"}
{"plan_idx": 623, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 623, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the grapefruit segments are needed to be arranged with the smoked salmon in Step 6.\"\n}"}
{"plan_idx": 624, "title": "spiced butternut squash soup", "question_idx": 624, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 13], "binary_question": "Must Step 9 happen before Step 14?", "why_question": "Why must Step 9 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 9 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chicken stock needs to be added before the soup is seasoned and heated through.\"\n}"}
{"plan_idx": 625, "title": "strawberry-tiramisu-trifle", "question_idx": 625, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 5 because the soaked sponge fingers need to be lined in the glass bowl before adding the strawberries and other layers.\"\n}"}
{"plan_idx": 626, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 626, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Blanching the spinach leaves in Step 4 makes them easier to work with and ensures they are cooked before grilling in Step 8.\"\n}"}
{"plan_idx": 627, "title": "creamy-chayote-squash-soup", "question_idx": 627, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 3 happen before Step 7?", "why_question": "Why must Step 3 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 3 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 7 because the ingredients need to be cooked before simmering for 20 minutes in Step 7.\"\n}"}
{"plan_idx": 628, "title": "almond and apple cake", "question_idx": 628, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 5 happen before Step 8?", "why_question": "Why must Step 5 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 5 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 8 because the eggs need to be well beaten into the mixture before adding the flour and milk.\"\n}"}
{"plan_idx": 629, "title": "scone-pastry", "question_idx": 629, "steps": ["Sift the flour, baking powder and salt into a bowl.", "Add the butter and rub in until the mixture resembles fine crumbs.", "Make a well in the centre and add the milk.", "Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.", "Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: scone-pastry\n\nProcedure:\n1. Sift the flour, baking powder and salt into a bowl.\n2. Add the butter and rub in until the mixture resembles fine crumbs.\n3. Make a well in the centre and add the milk.\n4. Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.\n5. Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 5 because the dough needs to be prepared and ready for rolling out in Step 5.\"\n}"}
{"plan_idx": 630, "title": "fusilli-and-meatballs", "question_idx": 630, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 17], "binary_question": "Must Step 11 happen before Step 18?", "why_question": "Why must Step 11 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 11 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be cooked before being added to the tomato sauce in Step 17.\"\n}"}
{"plan_idx": 631, "title": "spanish-rabbit-stew", "question_idx": 631, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 1 happen before Step 4?", "why_question": "Why must Step 1 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 1 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 4 because the ingredients need to be in the slow cooker before adding the wine and water.\"\n}"}
{"plan_idx": 632, "title": "cloud-bread", "question_idx": 632, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 4 happen before Step 6?", "why_question": "Why must Step 4 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 4 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the egg whites need to be beaten to stiff peaks before being folded into the cream cheese and egg yolk mixture.\"\n}"}
{"plan_idx": 633, "title": "chocolate-chocolate-cake", "question_idx": 633, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 20], "binary_question": "Must Step 13 happen before Step 21?", "why_question": "Why must Step 13 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 13 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, step 21 can happen before step 13 as it is not dependent on the folding of egg white mixture into the chocolate mixture.\"\n}"}
{"plan_idx": 634, "title": "lamb-curry--serves-4-", "question_idx": 634, "steps": ["Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.", "Fry the lamb in a little oil, then add the remaining onion.", "Gently fry for a minute, then add the paste and cook for a couple of minutes.", "Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.", "Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lamb-curry--serves-4-\n\nProcedure:\n1. Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.\n2. Fry the lamb in a little oil, then add the remaining onion.\n3. Gently fry for a minute, then add the paste and cook for a couple of minutes.\n4. Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.\n5. Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The paste needs to cook for a couple of minutes before adding the water and other ingredients in Step 4.\"\n}"}
{"plan_idx": 635, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 635, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 15], "binary_question": "Must Step 2 happen before Step 16?", "why_question": "Why must Step 2 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 2 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 16 because the shortcakes need to be baked before they can be assembled with the strawberries and whipped cream.\"\n}"}
{"plan_idx": 636, "title": "simple-basic-cupcakes", "question_idx": 636, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 7 because the batter needs to be spooned into the muffin tin before baking.\"\n}"}
{"plan_idx": 637, "title": "banana-split-cake", "question_idx": 637, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 5 because the base needs to be baked and cooled before adding the filling.\"\n}"}
{"plan_idx": 638, "title": "lightly spiced tomato and red lentil soup", "question_idx": 638, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 9 because the bay leaf needs to be removed before blending the soup.\"\n}"}
{"plan_idx": 639, "title": "chicken-prawn-and-rice-soup", "question_idx": 639, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 12], "binary_question": "Must Step 3 happen before Step 13?", "why_question": "Why must Step 3 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 3 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 3 does not need to happen before Step 13 because Step 3 involves cooking the prawns and chicken, while Step 13 involves serving the soup, which can be done after the soup is fully prepared.\" \n}"}
{"plan_idx": 640, "title": "balsamic-and-mozzarella-chicken", "question_idx": 640, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 4 happen before Step 7?", "why_question": "Why must Step 4 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 4 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the chicken needs to be cooked before adding the mozzarella, basil, and tomato.\"\n}"}
{"plan_idx": 641, "title": "chocolate-pancake-batter", "question_idx": 641, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 3 happen before Step 9?", "why_question": "Why must Step 3 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 3 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 9 because the batter needs to be prepared before it can be used to cook the pancakes.\"\n}"}
{"plan_idx": 642, "title": "almond and apple cake", "question_idx": 642, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 13], "binary_question": "Must Step 13 happen before Step 14?", "why_question": "Why must Step 13 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 13 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cake needs to cool slightly before being turned out onto a serving plate.\"\n}"}
{"plan_idx": 643, "title": "butternut-squash-pastry-for-pies", "question_idx": 643, "steps": ["Place the flour, egg and squash into the container of a food processor.", "Pulse until mixed into a doughy ball.", "You may need to add a little extra flour.", "Divide into two equal parts.", "Use in a pie or pastie recipe."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: butternut-squash-pastry-for-pies\n\nProcedure:\n1. Place the flour, egg and squash into the container of a food processor.\n2. Pulse until mixed into a doughy ball.\n3. You may need to add a little extra flour.\n4. Divide into two equal parts.\n5. Use in a pie or pastie recipe.\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to combine the ingredients before forming the dough in Step 2.\"\n}"}
{"plan_idx": 644, "title": "almond and apple cake", "question_idx": 644, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 13], "binary_question": "Must Step 2 happen before Step 14?", "why_question": "Why must Step 2 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 2 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 14 to ensure that the cake tin is properly prepared before the cake is baked and served.\"\n}"}
{"plan_idx": 645, "title": "slow cooker butter chicken", "question_idx": 645, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 1 happen before Step 6?", "why_question": "Why must Step 1 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 1 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to cook the chicken and onion before transferring to the slow cooker in Step 5.\"\n}"}
{"plan_idx": 646, "title": "fusilli-and-meatballs", "question_idx": 646, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [12, 17], "binary_question": "Must Step 13 happen before Step 18?", "why_question": "Why must Step 13 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be cooked before being added to the tomato sauce in Step 17.\"\n}"}
{"plan_idx": 647, "title": "fusilli-and-meatballs", "question_idx": 647, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 1 happen before Step 4?", "why_question": "Why must Step 1 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 1 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 4 because the onion mixture is needed for the meatball mixture in Step 12.\"\n}"}
{"plan_idx": 648, "title": "chocolate-chocolate-cake", "question_idx": 648, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [13, 21], "binary_question": "Must Step 14 happen before Step 22?", "why_question": "Why must Step 14 happen before Step 22?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 14 happen before Step 22?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 22 can happen before Step 14 as it is not dependent on the cake being in the tin.\"\n}"}
{"plan_idx": 649, "title": "cranachan", "question_idx": 649, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The toasted oats need to cool before being folded into the whipped cream in Step 7.\"\n}"}
{"plan_idx": 650, "title": "vegetable-terrine", "question_idx": 650, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 3 happen before Step 11?", "why_question": "Why must Step 3 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 3 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The vegetables need to be cooled before arranging them in the terrine.\"\n}"}
{"plan_idx": 651, "title": "lightly spiced tomato and red lentil soup", "question_idx": 651, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 2 happen before Step 12?", "why_question": "Why must Step 2 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 2 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 12 can happen after Step 2, as Step 12 is the final step in serving the soup and Step 2 is part of the cooking process.\"\n}"}
{"plan_idx": 652, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 652, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 7 because dividing the dough in half is the next logical step after kneading it 10 times.\"\n}"}
{"plan_idx": 653, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 653, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 4 because the mushrooms need to be cooked in the softened onions and their juices.\"\n}"}
{"plan_idx": 654, "title": "spiced butternut squash soup", "question_idx": 654, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [10, 16], "binary_question": "Must Step 11 happen before Step 17?", "why_question": "Why must Step 11 happen before Step 17?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen before Step 17?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 does not need to happen before Step 17 because the heating through in Step 16 will ensure that the soup is hot before serving.\"\n}"}
{"plan_idx": 655, "title": "chocolate-chocolate-cake", "question_idx": 655, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 5 because the chocolate mixture needs to cool before being added to the butter and sugar mixture.\"\n}"}
{"plan_idx": 656, "title": "halloumi-and-figs", "question_idx": 656, "steps": ["Preheat a grill for high heat.", "Break up the halloumi cheese, and toss with the fresh figs and walnuts in a small dish.", "Grill under the preheated grill until the halloumi is browned and the figs begin to caramelise, about 3 minutes.", "Drizzle with the honey."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: halloumi-and-figs\n\nProcedure:\n1. Preheat a grill for high heat.\n2. Break up the halloumi cheese, and toss with the fresh figs and walnuts in a small dish.\n3. Grill under the preheated grill until the halloumi is browned and the figs begin to caramelise, about 3 minutes.\n4. Drizzle with the honey.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 4 because the halloumi cheese, figs, and walnuts need to be grilled before being drizzled with honey.\"\n}"}
{"plan_idx": 657, "title": "green-tofu-curry", "question_idx": 657, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 5 happen before Step 12?", "why_question": "Why must Step 5 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 5 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 12 because the green curry sauce needs to be drizzled over the tofu and rice, which requires it to be prepared before serving.\"\n}"}
{"plan_idx": 658, "title": "fusilli-and-meatballs", "question_idx": 658, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [11, 17], "binary_question": "Must Step 12 happen before Step 18?", "why_question": "Why must Step 12 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 12 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The meatballs need to be cooked before being added to the tomato sauce in Step 18.\"\n}"}
{"plan_idx": 659, "title": "chicken-prawn-and-rice-soup", "question_idx": 659, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The prawns and chicken mixture needs to be cooked before being added to the pot with the stock and other ingredients.\"\n}"}
{"plan_idx": 660, "title": "chicken and vegetable pie", "question_idx": 660, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 8 happen before Step 13?", "why_question": "Why must Step 8 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 8 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 8 must happen before Step 13 because the hot liquid mixture needs to be poured over the chicken mixture before covering with the top pastry.\"\n}"}
{"plan_idx": 661, "title": "lamb-curry--serves-4-", "question_idx": 661, "steps": ["Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.", "Fry the lamb in a little oil, then add the remaining onion.", "Gently fry for a minute, then add the paste and cook for a couple of minutes.", "Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.", "Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lamb-curry--serves-4-\n\nProcedure:\n1. Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.\n2. Fry the lamb in a little oil, then add the remaining onion.\n3. Gently fry for a minute, then add the paste and cook for a couple of minutes.\n4. Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.\n5. Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 4 can happen before Step 2 because the lamb can be simmered for a few hours before adding the remaining ingredients.\"\n}"}
{"plan_idx": 662, "title": "tomato and basil salad", "question_idx": 662, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 2 happen before Step 5?", "why_question": "Why must Step 2 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 2 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 5 because the tomatoes need to be sliced and arranged on the plate before covering and leaving at room temperature.\"\n}"}
{"plan_idx": 663, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 663, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 8 because the spinach rolls need to be brushed with olive oil before grilling to achieve the desired texture and flavor.\" \n}"}
{"plan_idx": 664, "title": "lightly spiced tomato and red lentil soup", "question_idx": 664, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 4 happen before Step 11?", "why_question": "Why must Step 4 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 4 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 11 because the spices need to be cooked to release their flavors before the soup is seasoned to taste.\"\n}"}
{"plan_idx": 665, "title": "chocolate-chocolate-cake", "question_idx": 665, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 15], "binary_question": "Must Step 7 happen before Step 16?", "why_question": "Why must Step 7 happen before Step 16?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 7 happen before Step 16?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The mixture needs to be prepared before pouring it into the cake tin.\"\n}"}
{"plan_idx": 666, "title": "chicken and vegetable pie", "question_idx": 666, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 9 happen before Step 13?", "why_question": "Why must Step 9 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 9 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The hot liquid mixture needs to be poured over the chicken mixture before covering with the top pastry in Step 13.\"\n}"}
{"plan_idx": 667, "title": "chicken and vegetable pie", "question_idx": 667, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 14], "binary_question": "Must Step 8 happen before Step 15?", "why_question": "Why must Step 8 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 8 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The liquid mixture needs to be thickened before pouring it over the chicken mixture and baking the pie.\"\n}"}
{"plan_idx": 668, "title": "no-sugar-rock-cakes", "question_idx": 668, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 5 because the flour and Splenda need to be mixed with the butter before adding the egg and currants to form the dough.\"\n}"}
{"plan_idx": 669, "title": "white bread", "question_idx": 669, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 2 happen before Step 9?", "why_question": "Why must Step 2 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 2 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 9 because allowing the yeast to proof is necessary for the dough to rise properly.\"\n}"}
{"plan_idx": 670, "title": "chocolate-pancake-batter", "question_idx": 670, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 4 happen before Step 8?", "why_question": "Why must Step 4 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 4 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 allows the batter to rest and develop flavor, which is important before cooking the pancakes in Step 8.\"\n}"}
{"plan_idx": 671, "title": "easy strawberry tart", "question_idx": 671, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 4 happen before Step 6?", "why_question": "Why must Step 4 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 4 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, Step 4 must happen before Step 6 because the strawberries need to be well coated before the mixture is poured into the base and chilled.\"\n}"}
{"plan_idx": 672, "title": "one-pot irish stew", "question_idx": 672, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 needs to happen before Step 5 because it allows the potatoes to break up and thicken the stew before adding the remaining potatoes and carrots.\"\n}"}
{"plan_idx": 673, "title": "chocolate-chocolate-cake", "question_idx": 673, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 19], "binary_question": "Must Step 5 happen before Step 20?", "why_question": "Why must Step 5 happen before Step 20?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 5 happen before Step 20?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cake needs to cool in the tin for 10 minutes to set before being removed and allowed to cool completely.\"\n}"}
{"plan_idx": 674, "title": "spiced-pumpkin-teabread", "question_idx": 674, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 4 happen before Step 14?", "why_question": "Why must Step 4 happen before Step 14?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 4 happen before Step 14?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 is necessary to prepare the pumpkin mixture before baking the teabread.\"\n}"}
{"plan_idx": 675, "title": "chocolate-pancake-batter", "question_idx": 675, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 3 happen before Step 11?", "why_question": "Why must Step 3 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 3 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 11 because the batter needs to be prepared before cooking the pancakes.\"\n}"}
{"plan_idx": 676, "title": "chicken-prawn-and-rice-soup", "question_idx": 676, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 6 happen before Step 7?", "why_question": "Why must Step 6 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 6 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 7 because salt and sherry are added after bringing the mixture to a boil.\"\n}"}
{"plan_idx": 677, "title": "no-sugar-rock-cakes", "question_idx": 677, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 2 happen before Step 9?", "why_question": "Why must Step 2 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 2 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 is necessary to prepare the baking tray before the rock cakes are baked and need to be removed from the tray to cool in Step 9.\"\n}"}
{"plan_idx": 678, "title": "shellabina-s-corned-beef-hash", "question_idx": 678, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 1 happen before Step 6?", "why_question": "Why must Step 1 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 1 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 needs to happen before Step 6 because the potatoes, carrots, and onion need to be cooked before the stew is ready to serve.\"\n}"}
{"plan_idx": 679, "title": "chocolate-pancake-batter", "question_idx": 679, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 2 happen before Step 11?", "why_question": "Why must Step 2 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 2 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, Step 2 does not need to happen before Step 11 because Step 11 is the final step in the procedure and Step 2 is part of the initial preparation of the batter.\"\n}"}
{"plan_idx": 680, "title": "fusilli-and-meatballs", "question_idx": 680, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 2 happen before Step 4?", "why_question": "Why must Step 2 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 2 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 4 because the onion mixture from Step 2 is needed for the meatball mixture in Step 12.\"\n}"}
{"plan_idx": 681, "title": "brown sugar shortbread", "question_idx": 681, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 3 happen before Step 10?", "why_question": "Why must Step 3 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 3 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 10 because the dough needs to be prepared before baking.\" \n}"}
{"plan_idx": 682, "title": "tortellini-fritto-with-almond-butter", "question_idx": 682, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 3 happen before Step 5?", "why_question": "Why must Step 3 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 3 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 5 because the tortellini needs to be fried before adding the almond butter and other ingredients.\"\n}"}
{"plan_idx": 683, "title": "balsamic-and-mozzarella-chicken", "question_idx": 683, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 7 happen before Step 10?", "why_question": "Why must Step 7 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 7 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 7 does not need to happen before Step 10 because the chicken can be served before adding the mozzarella, basil, tomato, and balsamic vinegar.\"\n}"}
{"plan_idx": 684, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 684, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 5 happen before Step 10?", "why_question": "Why must Step 5 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 5 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 5 does not need to happen before Step 10 because Step 5 involves adding flavor to the mushrooms, while Step 10 is the final step of serving the dish.\"\n}"}
{"plan_idx": 685, "title": "chocolate-pancake-batter", "question_idx": 685, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 3 happen before Step 8?", "why_question": "Why must Step 3 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 3 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 8 because the batter needs to be prepared before it can be cooked.\"\n}"}
{"plan_idx": 686, "title": "chocolate-pancake-batter", "question_idx": 686, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 8 happen before Step 9?", "why_question": "Why must Step 8 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 8 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 9 because it involves cooking the pancake until the edges start to crisp up before flipping it to cook the other side.\"\n}"}
{"plan_idx": 687, "title": "chocolate-pancake-batter", "question_idx": 687, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 5 happen before Step 7?", "why_question": "Why must Step 5 happen before Step 7?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 5 happen before Step 7?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 5 must happen before Step 7 because the frying pan needs to be heated before pouring the batter.\"\n}"}
{"plan_idx": 688, "title": "fusilli-and-meatballs", "question_idx": 688, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 1 happen before Step 2?", "why_question": "Why must Step 1 happen before Step 2?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 1 happen before Step 2?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 is necessary to prepare the saucepan for saut\u00e9ing the onion and garlic in Step 2.\"\n}"}
{"plan_idx": 689, "title": "vegetable-terrine", "question_idx": 689, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [13, 14], "binary_question": "Must Step 14 happen before Step 15?", "why_question": "Why must Step 14 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 14 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 15 must happen before Step 14 because the terrine needs to be chilled before it can be served.\"\n}"}
{"plan_idx": 690, "title": "chicken-prawn-and-rice-soup", "question_idx": 690, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 2 happen before Step 8?", "why_question": "Why must Step 2 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 2 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 needs to happen before Step 8 because the oil needs to be hot before adding the prawns and chicken mixture, and then the remaining oil needs to be heated for browning the rice.\"\n}"}
{"plan_idx": 691, "title": "vegetable-terrine", "question_idx": 691, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [4, 14], "binary_question": "Must Step 5 happen before Step 15?", "why_question": "Why must Step 5 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 5 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cream mixture needs to be brought to a boil and then cooled before serving chilled in Step 15.\"\n}"}
{"plan_idx": 692, "title": "banana-split-cake", "question_idx": 692, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 1 happen before Step 11?", "why_question": "Why must Step 1 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 1 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 1 must happen before Step 11 because the oven needs to be preheated before baking the cake, and Step 11 involves covering the cake with whipped cream after it has been baked.\"\n}"}
{"plan_idx": 693, "title": "chocolate-chocolate-cake", "question_idx": 693, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 6 happen before Step 10?", "why_question": "Why must Step 6 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 6 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The cooled chocolate is added to the butter and margarine mixture in Step 10, so Step 6 must happen before Step 10.\"\n}"}
{"plan_idx": 694, "title": "chocolate-chocolate-cake", "question_idx": 694, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 20], "binary_question": "Must Step 9 happen before Step 21?", "why_question": "Why must Step 9 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 9 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"No, Step 21 can happen before Step 9 as it is not dependent on the order of the two steps.\"\n}"}
{"plan_idx": 695, "title": "cloud-bread", "question_idx": 695, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 4 happen before Step 5?", "why_question": "Why must Step 4 happen before Step 5?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 4 happen before Step 5?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Yes, because the egg whites need to be beaten until stiff peaks form before folding in the cream cheese and egg yolk mixture.\"\n}"}
{"plan_idx": 696, "title": "chocolate-chocolate-cake", "question_idx": 696, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [3, 20], "binary_question": "Must Step 4 happen before Step 21?", "why_question": "Why must Step 4 happen before Step 21?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 4 happen before Step 21?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 4 must happen before Step 21 because the cake needs to set and cool completely before adding icing sugar for decoration.\"\n}"}
{"plan_idx": 697, "title": "lightly spiced tomato and red lentil soup", "question_idx": 697, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 8 happen before Step 10?", "why_question": "Why must Step 8 happen before Step 10?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 8 happen before Step 10?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 8 must happen before Step 10 because the bay leaf needs to be removed before checking the consistency and adjusting it with more stock.\"\n}"}
{"plan_idx": 698, "title": "brown sugar shortbread", "question_idx": 698, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 6 happen before Step 8?", "why_question": "Why must Step 6 happen before Step 8?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 6 happen before Step 8?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 8 because the dough needs to be kneaded and rolled to the specified thickness before cutting into strips.\"\n}"}
{"plan_idx": 699, "title": "vegetable-terrine", "question_idx": 699, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 14], "binary_question": "Must Step 2 happen before Step 15?", "why_question": "Why must Step 2 happen before Step 15?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 2 happen before Step 15?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The terrine needs to be refrigerated for several hours to firm up before it can be served chilled.\"\n}"}
{"plan_idx": 700, "title": "spiced butternut squash soup", "question_idx": 700, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 7 happen before Step 11?", "why_question": "Why must Step 7 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 7 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 7 needs to happen before Step 11 because the potatoes need to be cooked in the chicken stock before adding the squash.\"\n}"}
{"plan_idx": 701, "title": "strawberries-in-pimm-s", "question_idx": 701, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 3 happen before Step 6?", "why_question": "Why must Step 3 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 3 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 6 because the strawberries need to stand at room temperature for 15 minutes before garnishing with mint leaves.\"\n}"}
{"plan_idx": 702, "title": "almost no fat banana bread", "question_idx": 702, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 3 happen before Step 4?", "why_question": "Why must Step 3 happen before Step 4?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 3 happen before Step 4?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 3 must happen before Step 4 because the dry ingredients need to be mixed before adding the wet ingredients.\"\n}"}
{"plan_idx": 703, "title": "curried bbq mussels", "question_idx": 703, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 3 happen before Step 11?", "why_question": "Why must Step 3 happen before Step 11?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 3 happen before Step 11?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"Step 11 can happen after Step 3, as Step 3 involves arranging foil and Step 11 involves transferring the mussels to small bowls and garnishing with lime wedge.\"\n}"}
{"plan_idx": 704, "title": "spiced-pumpkin-teabread", "question_idx": 704, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 9 happen before Step 12?", "why_question": "Why must Step 9 happen before Step 12?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 9 happen before Step 12?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 9 must happen before Step 12 because the loaf needs to cool in the tin for 10 minutes before being turned out onto a wire rack.\"\n}"}
{"plan_idx": 705, "title": "rouille", "question_idx": 705, "steps": ["In a mortar, crush the garlic to a fine mash.", "Transfer to a mixing bowl.", "Add the egg yolks, and beat into a mayonnaise while adding the olive oil.", "When the sauce is thick and smooth, stir in the cayenne pepper and saffron."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 2 happen before Step 3?", "why_question": "Why must Step 2 happen before Step 3?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: rouille\n\nProcedure:\n1. In a mortar, crush the garlic to a fine mash.\n2. Transfer to a mixing bowl.\n3. Add the egg yolks, and beat into a mayonnaise while adding the olive oil.\n4. When the sauce is thick and smooth, stir in the cayenne pepper and saffron.\n\n\n1. Must Step 2 happen before Step 3?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 3 because the garlic needs to be transferred to the mixing bowl before adding the egg yolks and beating them into a mayonnaise.\" \n}"}
{"plan_idx": 706, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 706, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 2 happen before Step 6?", "why_question": "Why must Step 2 happen before Step 6?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 2 happen before Step 6?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 2 must happen before Step 6 because the dry ingredients need to be combined before dividing the dough.\"\n}"}
{"plan_idx": 707, "title": "chocolate-chocolate-cake", "question_idx": 707, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [1, 12], "binary_question": "Must Step 2 happen before Step 13?", "why_question": "Why must Step 2 happen before Step 13?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 2 happen before Step 13?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"The chocolate mixture needs to be prepared before it can be folded into the egg white mixture in Step 13.\"\n}"}
{"plan_idx": 708, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 708, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 6 happen before Step 9?", "why_question": "Why must Step 6 happen before Step 9?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 6 happen before Step 9?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"yes\",\n  \"why_answer\": \"Step 6 must happen before Step 9 because the spinach rolls need to be brushed with olive oil before grilling, and then allowed to cool after grilling.\"\n}"}
{"plan_idx": 709, "title": "fusilli-and-meatballs", "question_idx": 709, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_before", "step_pair_idx_asked_about": [9, 17], "binary_question": "Must Step 10 happen before Step 18?", "why_question": "Why must Step 10 happen before Step 18?", "model_name": "gpt-3.5-turbo-1106", "prompt_key": "basic_binary_explain", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 10 happen before Step 18?\n2. Explain why or why not.\n\nFormat your answer as JSON with the key value pairs \"binary_answer\": \"yes/no answer to Q1\", \"why_answer\": \"one sentence answer to Q2\"", "model_answer": "{\n  \"binary_answer\": \"no\",\n  \"why_answer\": \"The meatballs are added to the tomato sauce in Step 17, so Step 10 does not need to happen before Step 18.\"\n}"}
