{"plan_idx": 0, "title": "spicy-tomato-anchovy-pasta", "question_idx": 0, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 specifies serving the dish, which should be done after tossing the linguine with the anchovy mixture and chilli flakes in Step 8."}
{"plan_idx": 1, "title": "one-pot irish stew", "question_idx": 1, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 8 (stir in fresh parsley or chopped leeks) and Step 7 (season well with salt and pepper to taste) can be done in any order."}
{"plan_idx": 2, "title": "easy strawberry tart", "question_idx": 2, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 needs to happen after Step 6 because the tart needs to be chilled before it is served."}
{"plan_idx": 3, "title": "almond and apple cake", "question_idx": 3, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 involves stirring in the ground almonds, which should be done after Step 6 to ensure all the dry ingredients are evenly distributed."}
{"plan_idx": 4, "title": "chocolate-chocolate-cake", "question_idx": 4, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 20], "binary_question": "Must Step 21 happen after Step 1?", "why_question": "Why must Step 21 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 21 should happen after Step 20 when the cake has cooled in the tin for 10 minutes, not after Step 1."}
{"plan_idx": 5, "title": "fusilli-and-meatballs", "question_idx": 5, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 16], "binary_question": "Must Step 17 happen after Step 5?", "why_question": "Why must Step 17 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 17 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 instructs you to whiz the tomatoes in a food processor while Step 17 instructs you to add the meatballs to the tomato sauce, so Step 17 does not have to happen after Step 5."}
{"plan_idx": 6, "title": "spiced butternut squash soup", "question_idx": 6, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 14], "binary_question": "Must Step 15 happen after Step 2?", "why_question": "Why must Step 15 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 15 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 does not depend on having completed step 2, as the two steps do not involve the same ingredients or actions."}
{"plan_idx": 7, "title": "spiced butternut squash soup", "question_idx": 7, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 14], "binary_question": "Must Step 15 happen after Step 4?", "why_question": "Why must Step 15 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 15 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 does not depend on the squash being cooked, so it can be done before Step 4."}
{"plan_idx": 8, "title": "vegetable-terrine", "question_idx": 8, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11, Arranging the vegetables, should occur after Step 10, wherein the appropriate mould is chosen."}
{"plan_idx": 9, "title": "almond and apple cake", "question_idx": 9, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 9 must happen after Step 8 because the remaining flour and milk must be added after the first half of each has been stirred in."}
{"plan_idx": 10, "title": "jam-drop-biscuits", "question_idx": 10, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 2 instructs to sieve in flour and fold in, whereas Step 4 specifies rolling the dough in ground hazelnuts, so Step 2 does not have to be completed before Step 4."}
{"plan_idx": 11, "title": "scone-pastry", "question_idx": 11, "steps": ["Sift the flour, baking powder and salt into a bowl.", "Add the butter and rub in until the mixture resembles fine crumbs.", "Make a well in the centre and add the milk.", "Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.", "Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: scone-pastry\n\nProcedure:\n1. Sift the flour, baking powder and salt into a bowl.\n2. Add the butter and rub in until the mixture resembles fine crumbs.\n3. Make a well in the centre and add the milk.\n4. Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.\n5. Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not have to be done immediately after Step 3, as it involves kneading and rolling out the dough, which can be done later on."}
{"plan_idx": 12, "title": "green-tofu-curry", "question_idx": 12, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: It is necessary to place water in the saucepan and stir in the rice before bringing it to the boil."}
{"plan_idx": 13, "title": "chicory-and-roquefort-salad", "question_idx": 13, "steps": ["In a bowl, toss chicory, Roquefort and pecan nuts together.", "Make the dressing by mixing together cream cheese, yoghurt and salt and pepper.", "Drizzle over salad."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicory-and-roquefort-salad\n\nProcedure:\n1. In a bowl, toss chicory, Roquefort and pecan nuts together.\n2. Make the dressing by mixing together cream cheese, yoghurt and salt and pepper.\n3. Drizzle over salad.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 depends on the completion of Step 2, as the dressing is made in Step 2 and used in Step 3."}
{"plan_idx": 14, "title": "fusilli-and-meatballs", "question_idx": 14, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [14, 19], "binary_question": "Must Step 20 happen after Step 15?", "why_question": "Why must Step 20 happen after Step 15?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 20 happen after Step 15?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 20 does not depend on Step 15 since the meatballs are cooked separately from the pasta."}
{"plan_idx": 15, "title": "very-vanilla-ry-cheesecake", "question_idx": 15, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 12], "binary_question": "Must Step 13 happen after Step 10?", "why_question": "Why must Step 13 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 13 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not depend on Step 10 being completed."}
{"plan_idx": 16, "title": "simple-basic-cupcakes", "question_idx": 16, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not depend on Step 4 and can be performed regardless of whether Step 4 was executed or not."}
{"plan_idx": 17, "title": "scone-pastry", "question_idx": 17, "steps": ["Sift the flour, baking powder and salt into a bowl.", "Add the butter and rub in until the mixture resembles fine crumbs.", "Make a well in the centre and add the milk.", "Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.", "Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: scone-pastry\n\nProcedure:\n1. Sift the flour, baking powder and salt into a bowl.\n2. Add the butter and rub in until the mixture resembles fine crumbs.\n3. Make a well in the centre and add the milk.\n4. Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.\n5. Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 (kneading and rolling out the dough) must happen after Step 4 (mixing the dough) to ensure a cohesive and pliable dough."}
{"plan_idx": 18, "title": "white bread", "question_idx": 18, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 must happen after Step 5 because the dough needs to be kneaded before it can be placed in a bowl and covered with a damp cloth."}
{"plan_idx": 19, "title": "jam-drop-biscuits", "question_idx": 19, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not depend on the completion of Step 1."}
{"plan_idx": 20, "title": "curried bbq mussels", "question_idx": 20, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The mussels need to be wrapped in foil before they are cooked on the barbecue, so Step 9 must happen after Step 8."}
{"plan_idx": 21, "title": "tangy-gammon-in-cider", "question_idx": 21, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not require Step 2 to have been completed first."}
{"plan_idx": 22, "title": "brown sugar shortbread", "question_idx": 22, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (bake in the oven) must not happen after Step 4 (mix well), but after Step 9 (place on ungreased baking trays)."}
{"plan_idx": 23, "title": "spicy-tomato-anchovy-pasta", "question_idx": 23, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 (draining the linguine) must happen after Step 6 (cooking the linguine until al dente) because the linguine needs to be cooked before it can be drained."}
{"plan_idx": 24, "title": "spiced-pumpkin-teabread", "question_idx": 24, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 13 happen after Step 9?", "why_question": "Why must Step 13 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 13 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not depend on the completion of Step 9."}
{"plan_idx": 25, "title": "vegetable-terrine", "question_idx": 25, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 14], "binary_question": "Must Step 15 happen after Step 10?", "why_question": "Why must Step 15 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 15 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 is about serving the terrine, which can be done regardless of the type of mould used in Step 10."}
{"plan_idx": 26, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 26, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 15], "binary_question": "Must Step 16 happen after Step 4?", "why_question": "Why must Step 16 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 16 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16 involves assembling the shortcakes, which cannot be done before completing steps 5-15, which create the individual components of the dessert."}
{"plan_idx": 27, "title": "chocolate-chocolate-cake", "question_idx": 27, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 21], "binary_question": "Must Step 22 happen after Step 10?", "why_question": "Why must Step 22 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 22 should happen after Step 21 because the cake needs to be cooled completely before it can be decorated with icing sugar."}
{"plan_idx": 28, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 28, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not depend on Step 3 and can happen after any other step in the procedure."}
{"plan_idx": 29, "title": "fusilli-and-meatballs", "question_idx": 29, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 19], "binary_question": "Must Step 20 happen after Step 11?", "why_question": "Why must Step 20 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 20 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 20, cooking the pasta, can happen independently of Step 11, processing the bread into crumbs."}
{"plan_idx": 30, "title": "almond and apple cake", "question_idx": 30, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 13 happen after Step 8?", "why_question": "Why must Step 13 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 13 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not depend on Step 8 and can happen independently."}
{"plan_idx": 31, "title": "spiced butternut squash soup", "question_idx": 31, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 12], "binary_question": "Must Step 13 happen after Step 7?", "why_question": "Why must Step 13 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 13 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 involves melting butter, while Step 13 is about pureeing the soup, so Step 13 does not need to happen after Step 7."}
{"plan_idx": 32, "title": "vegetable-terrine", "question_idx": 32, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 14], "binary_question": "Must Step 15 happen after Step 6?", "why_question": "Why must Step 15 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 15 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 does not need to happen after step 6 because Step 15 is about serving the terrine, while Step 6 is about adding the chopped sorrel and gelatin to the cream and yogurt mixture."}
{"plan_idx": 33, "title": "shellabina-s-corned-beef-hash", "question_idx": 33, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: The procedure does not specify that Step 4 must happen after Step 2."}
{"plan_idx": 34, "title": "white bread", "question_idx": 34, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 must happen after Step 6 because the dough needs to be placed in a well oiled bowl after the initial kneading in order to rise properly."}
{"plan_idx": 35, "title": "creamy-chayote-squash-soup", "question_idx": 35, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5, stirring in the stock and coriander, does not depend on Step 1, dissolving the stock in hot water."}
{"plan_idx": 36, "title": "balsamic-and-mozzarella-chicken", "question_idx": 36, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: According to the procedure, Step 8 must be performed after Step 6 because it instructs us to place basil leaves and tomato slices on top of the mozzarella that was placed on the chicken in Step 6."}
{"plan_idx": 37, "title": "cloud-bread", "question_idx": 37, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 requires the batter to be spooned onto the baking tray, which is not done until Step 7."}
{"plan_idx": 38, "title": "vegetable-terrine", "question_idx": 38, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 11 happen after Step 10?", "why_question": "Why must Step 11 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 11 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (arranging the vegetables) and Step 10 (using a silicone mold) are independent steps and can be done in either order."}
{"plan_idx": 39, "title": "black-rice-pudding", "question_idx": 39, "steps": ["Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.", "Bring to the boil over high heat, stirring frequently.", "Reduce heat to medium-low.", "Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.", "Stir in coconut cream and vanilla extract.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: black-rice-pudding\n\nProcedure:\n1. Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.\n2. Bring to the boil over high heat, stirring frequently.\n3. Reduce heat to medium-low.\n4. Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.\n5. Stir in coconut cream and vanilla extract.\n6. Serve warm.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 2 must happen after Step 1 because the rice needs to be rinsed and drained before it can be combined with the sugar and water."}
{"plan_idx": 40, "title": "balsamic-and-mozzarella-chicken", "question_idx": 40, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not depend on Step 3, as the pan is coated with oil before the chicken is removed from the marinade in Step 4."}
{"plan_idx": 41, "title": "lightly spiced tomato and red lentil soup", "question_idx": 41, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (seasoning to taste) should happen after Step 10 (adjusting the consistency and thickness of the soup as desired)."}
{"plan_idx": 42, "title": "white bread", "question_idx": 42, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why must Step 11 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 11 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 11 must happen after Step 9 because the dough must be punched down and kneaded before it can be shaped into loaves."}
{"plan_idx": 43, "title": "spiced-pumpkin-teabread", "question_idx": 43, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 12], "binary_question": "Must Step 13 happen after Step 5?", "why_question": "Why must Step 13 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 13 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 involves brushing the loaf with honey while it is still warm, which can only be done after the loaf has been baked, not after Step 5."}
{"plan_idx": 44, "title": "chicken and vegetable pie", "question_idx": 44, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 15], "binary_question": "Must Step 16 happen after Step 8?", "why_question": "Why must Step 16 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 16 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no.\nAnswer 2: Step 16 does not depend on Step 8 being completed first."}
{"plan_idx": 45, "title": "slow cooker butter chicken", "question_idx": 45, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 cannot be done before Step 6 because Step 6 requires seasoning the dish with salt, which is a necessary step before cooking."}
{"plan_idx": 46, "title": "brown sugar shortbread", "question_idx": 46, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 must happen after Step 2 because the butter and brown sugar need to be creamed together before the flour is added."}
{"plan_idx": 47, "title": "one-pot irish stew", "question_idx": 47, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 4 can happen after Step 3, as the instructions do not specify that Step 4 must happen after Step 1."}
{"plan_idx": 48, "title": "creamy-chayote-squash-soup", "question_idx": 48, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 (cover) must happen after Step 5 (stir in the stock) because the liquid needs to be covered in order to simmer properly."}
{"plan_idx": 49, "title": "fusilli-and-meatballs", "question_idx": 49, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [15, 16], "binary_question": "Must Step 17 happen after Step 16?", "why_question": "Why must Step 17 happen after Step 16?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 17 happen after Step 16?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 16 instructs you to drain the meatballs on kitchen paper, and Step 17 requires the drained meatballs to be added to the tomato sauce."}
{"plan_idx": 50, "title": "white bread", "question_idx": 50, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 can be performed after Step 9 because it involves dividing and shaping the dough before the second rise."}
{"plan_idx": 51, "title": "fusilli-and-meatballs", "question_idx": 51, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 20], "binary_question": "Must Step 21 happen after Step 3?", "why_question": "Why must Step 21 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 21 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 3 involves transferring 2 tablespoons of the onion mixture to a large bowl, while Step 21 involves spooning the meatballs and remaining sauce over the cooked pasta; therefore, Step 21 does not need to happen after Step 3."}
{"plan_idx": 52, "title": "one-pot irish stew", "question_idx": 52, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 (adding fresh parsley or chopped leeks) does not need to happen after Step 2 (bringing the lamb mixture to a boil and simmering it for 30 minutes)."}
{"plan_idx": 53, "title": "spiced butternut squash soup", "question_idx": 53, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 14], "binary_question": "Must Step 15 happen after Step 7?", "why_question": "Why must Step 15 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 15 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 does not require the melted butter from Step 7, so it can happen after or before Step 7."}
{"plan_idx": 54, "title": "white bread", "question_idx": 54, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 9 must happen after Step 7 because the dough needs to rise after being placed in the well oiled bowl and covered with a damp cloth."}
{"plan_idx": 55, "title": "lamb-curry--serves-4-", "question_idx": 55, "steps": ["Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.", "Fry the lamb in a little oil, then add the remaining onion.", "Gently fry for a minute, then add the paste and cook for a couple of minutes.", "Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.", "Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lamb-curry--serves-4-\n\nProcedure:\n1. Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.\n2. Fry the lamb in a little oil, then add the remaining onion.\n3. Gently fry for a minute, then add the paste and cook for a couple of minutes.\n4. Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.\n5. Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The procedure specifies the order of steps, and Step 5 must happen after Step 4 to add the fresh tomatoes and spinach to the curry after the curry has simmered for a few hours."}
{"plan_idx": 56, "title": "lightly spiced tomato and red lentil soup", "question_idx": 56, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 (removing the bay leaf from the soup) must happen after Step 5 because the bay leaf is added in Step 5 and must be removed before blending the soup in Step 9."}
{"plan_idx": 57, "title": "spiced-pumpkin-teabread", "question_idx": 57, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 12], "binary_question": "Must Step 13 happen after Step 11?", "why_question": "Why must Step 13 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 13 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The teabread should be brushed with the 2 tsp honey while it is still warm, which will happen after it is baked in Step 11."}
{"plan_idx": 58, "title": "strawberries-in-pimm-s", "question_idx": 58, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 is optional and does not have to be done after Step 4."}
{"plan_idx": 59, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 59, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not depend on Step 1; it can be done after any of the steps."}
{"plan_idx": 60, "title": "chocolate-chocolate-cake", "question_idx": 60, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 15], "binary_question": "Must Step 16 happen after Step 12?", "why_question": "Why must Step 16 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 16 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The cake mixture needs to be assembled and ready to go before pouring it into the tin."}
{"plan_idx": 61, "title": "simple-basic-cupcakes", "question_idx": 61, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Decorating the cupcakes is not a necessary step in the process of making simple-basic-cupcakes."}
{"plan_idx": 62, "title": "brown sugar shortbread", "question_idx": 62, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: You need to cut the pastry in step 8 before you can place it on baking trays in step 9."}
{"plan_idx": 63, "title": "balsamic-and-mozzarella-chicken", "question_idx": 63, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The marinade must be poured over the chicken placed in the shallow dish in Step 1."}
{"plan_idx": 64, "title": "almond and apple cake", "question_idx": 64, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 13], "binary_question": "Must Step 14 happen after Step 8?", "why_question": "Why must Step 14 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 14 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 must happen after Step 12, not step 8, because the cake needs to be baked first."}
{"plan_idx": 65, "title": "no-sugar-rock-cakes", "question_idx": 65, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 requires the dough to be made, which happens in Step 5."}
{"plan_idx": 66, "title": "chocolate-pancake-batter", "question_idx": 66, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 11 happen after Step 10?", "why_question": "Why must Step 11 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 11 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Yes, because Step 11 involves stacking the pancakes on top of each other to keep warm, which should be done after they have been cooked (step 10)."}
{"plan_idx": 67, "title": "chicken-prawn-and-rice-soup", "question_idx": 67, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "1. no\n2. The instructions do not specify that the steps must be performed in a particular order."}
{"plan_idx": 68, "title": "brown sugar shortbread", "question_idx": 68, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The shortbread needs to be cut and placed on baking trays before it is baked, as per Steps 7-9 of the procedure."}
{"plan_idx": 69, "title": "lightly spiced tomato and red lentil soup", "question_idx": 69, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The soup must be cooked before it can be blended."}
{"plan_idx": 70, "title": "vegetable-terrine", "question_idx": 70, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 must happen after Step 8, because Step 8 instructs to \"set aside and cool for a few minutes\" before pouring the cream mixture into the mould."}
{"plan_idx": 71, "title": "chicken and vegetable pie", "question_idx": 71, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 12 happen after Step 9?", "why_question": "Why must Step 12 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 12 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 9 instructs the reader to set aside the liquid mixture, which must be hot when poured over the chicken mixture in Step 12."}
{"plan_idx": 72, "title": "creamy-chayote-squash-soup", "question_idx": 72, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 9 is the final step in the procedure, while Step 5 is in the middle."}
{"plan_idx": 73, "title": "chicken and vegetable pie", "question_idx": 73, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 14], "binary_question": "Must Step 15 happen after Step 1?", "why_question": "Why must Step 15 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 15 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 (baking the pie) must happen after Step 14 (making slits in the top of the pie) to allow steam to escape during baking."}
{"plan_idx": 74, "title": "chocolate-pancake-batter", "question_idx": 74, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The procedure specifies that Step 4 should happen after Step 3, as the pancake batter needs to be whisked before being set aside to rest."}
{"plan_idx": 75, "title": "almond and apple cake", "question_idx": 75, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 12 happen after Step 11?", "why_question": "Why must Step 12 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 12 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 (baking the cake) must happen after Step 11 (spooning the mixture into the tin and smoothing the surface) because the cake needs to be baked before it can be turned onto a serving plate and served."}
{"plan_idx": 76, "title": "chocolate-chocolate-cake", "question_idx": 76, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 17], "binary_question": "Must Step 18 happen after Step 4?", "why_question": "Why must Step 18 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 18 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 18 checks the readiness of the cake so it must happen after Step 17, not Step 4."}
{"plan_idx": 77, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 77, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 must happen after Step 6 because the grapefruit juice for the dressing is collected during Step 6."}
{"plan_idx": 78, "title": "tomato and basil salad", "question_idx": 78, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 can be done after any step as it does not depend on the completion of any other step."}
{"plan_idx": 79, "title": "chicken-prawn-and-rice-soup", "question_idx": 79, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 12 happen after Step 3?", "why_question": "Why must Step 12 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 12 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 (adding the rice to the soup) does not need to happen after Step 3 (cooking the prawns and chicken mixture), as the rice is cooked separately and can be added at any point after it has been cooked."}
{"plan_idx": 80, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 80, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 15], "binary_question": "Must Step 16 happen after Step 3?", "why_question": "Why must Step 16 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 16 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 3 is about combining the dry ingredients for the shortcake dough, while step 16 is about assembling the shortcakes with strawberries, whipped cream and lemon butter, therefore, one does not need to happen after the other."}
{"plan_idx": 81, "title": "spiced-pumpkin-teabread", "question_idx": 81, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 9 requires the pumpkin mixture, which is created in Step 5."}
{"plan_idx": 82, "title": "fusilli-and-meatballs", "question_idx": 82, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [13, 15], "binary_question": "Must Step 16 happen after Step 14?", "why_question": "Why must Step 16 happen after Step 14?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 16 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The meatballs must be browned in the frying pan (Step 14) before they can be drained on kitchen paper (Step 16)."}
{"plan_idx": 83, "title": "green-tofu-curry", "question_idx": 83, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 can happen before Step 5 because the procedure does not specify an order for them."}
{"plan_idx": 84, "title": "slow cooker butter chicken", "question_idx": 84, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why must Step 8 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 8 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Removing the cardamom pods after cooking allows for easier serving and avoids potential choking hazards."}
{"plan_idx": 85, "title": "fusilli-and-meatballs", "question_idx": 85, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [14, 20], "binary_question": "Must Step 21 happen after Step 15?", "why_question": "Why must Step 21 happen after Step 15?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 21 happen after Step 15?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 is about browning the meatballs, while Step 21 is about serving the finished dish, therefore Step 21 does not have to happen after Step 15."}
{"plan_idx": 86, "title": "spiced-pumpkin-teabread", "question_idx": 86, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 14 happen after Step 5?", "why_question": "Why must Step 14 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 14 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 (gently brushing the teabread with honey) should happen after the teabread has been baked, cooled, and turned out onto a wire rack."}
{"plan_idx": 87, "title": "spiced butternut squash soup", "question_idx": 87, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 15], "binary_question": "Must Step 16 happen after Step 4?", "why_question": "Why must Step 16 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 16 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16 does not depend on Step 4 and can happen after any step in the procedure."}
{"plan_idx": 88, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 88, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 depends on Step 5 being completed to have the mushrooms coated in sauce."}
{"plan_idx": 89, "title": "curried bbq mussels", "question_idx": 89, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (discarding unopened mussels) can happen at any time after the mussels have been cooked."}
{"plan_idx": 90, "title": "spiced-guava-cake", "question_idx": 90, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The batter must be poured into the prepared tin before baking."}
{"plan_idx": 91, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 91, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not depend on Step 2 and can be performed at any time after Step 5."}
{"plan_idx": 92, "title": "tangy-gammon-in-cider", "question_idx": 92, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 doesn't have to happen after Step 2, it can happen after Step 5."}
{"plan_idx": 93, "title": "almond and apple cake", "question_idx": 93, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 14 happen after Step 5?", "why_question": "Why must Step 14 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 14 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14, 'serve warm', does not need to happen after Step 5, 'add the eggs'."}
{"plan_idx": 94, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 94, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not have to happen after Step 6 because the almonds can be sprinkled on top or the rolls can be rolled in the almonds at any time before grilling."}
{"plan_idx": 95, "title": "tortellini-fritto-with-almond-butter", "question_idx": 95, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not have to happen after Step 3 because the steps in the procedure are not dependent on each other."}
{"plan_idx": 96, "title": "spiced-pumpkin-teabread", "question_idx": 96, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 must happen after Step 9 because the mixture has to be in the tin before the pumpkin seeds can be sprinkled."}
{"plan_idx": 97, "title": "slow cooker butter chicken", "question_idx": 97, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 (adding ingredients to the slow cooker) must happen after Step 4 (stirring everything together in the frying pan) because the ingredients need to be mixed together first."}
{"plan_idx": 98, "title": "slow cooker butter chicken", "question_idx": 98, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 requires that the onion has first softened and turned translucent, which is completed in Step 3."}
{"plan_idx": 99, "title": "lightly spiced tomato and red lentil soup", "question_idx": 99, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 2, 3, and 4 can be completed in any order as long as they are completed before Step 5."}
{"plan_idx": 100, "title": "spanish-rabbit-stew", "question_idx": 100, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not depend on Step 4 and can be done after other steps in the procedure."}
{"plan_idx": 101, "title": "chocolate-chocolate-cake", "question_idx": 101, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 16], "binary_question": "Must Step 17 happen after Step 9?", "why_question": "Why must Step 17 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 17 (Bake for 1 hour) must happen after Step 9 as it involves adding the cooled chocolate mixture from Step 9 to the batter."}
{"plan_idx": 102, "title": "spiced-pumpkin-teabread", "question_idx": 102, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 can happen after Step 4 or Step 8 as long as Steps 2 and 3 are completed first."}
{"plan_idx": 103, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 103, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not require the mushrooms to be cooked before it can be performed."}
{"plan_idx": 104, "title": "strawberry-tiramisu-trifle", "question_idx": 104, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 involves spreading half of the strawberries, grated chocolate and custard mixture over the sponge fingers, which must be done after placing the first layer of sponge fingers (Step 6)."}
{"plan_idx": 105, "title": "spiced butternut squash soup", "question_idx": 105, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 15], "binary_question": "Must Step 16 happen after Step 3?", "why_question": "Why must Step 16 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 16 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16 involves heating the soup, which should be done after all the ingredients have been added, including the butternut squash in Step 12."}
{"plan_idx": 106, "title": "chicken and vegetable pie", "question_idx": 106, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 14], "binary_question": "Must Step 15 happen after Step 2?", "why_question": "Why must Step 15 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 15 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 (baking the pie) does not need to happen after Step 2 (boiling the chicken and vegetables)."}
{"plan_idx": 107, "title": "shellabina-s-corned-beef-hash", "question_idx": 107, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not have to happen after Step 2 because other steps must happen in between."}
{"plan_idx": 108, "title": "chicken and vegetable pie", "question_idx": 108, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 14 happen after Step 4?", "why_question": "Why must Step 14 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 14 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 14 (making slits in the top pastry) must happen after Step 4 (preparing the chicken mixture) because the chicken mixture has to be in the pie dish before the top pastry can be placed over it."}
{"plan_idx": 109, "title": "spiced-pumpkin-teabread", "question_idx": 109, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why must Step 11 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 11 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The bread must bake for 50 minutes according to Step 11 after it is placed in the tin in Step 9."}
{"plan_idx": 110, "title": "almond and apple cake", "question_idx": 110, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not have to happen after Step 4 as the rest of the steps, including 8, must be completed before Step 9 can be done."}
{"plan_idx": 111, "title": "chocolate-chocolate-cake", "question_idx": 111, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 21], "binary_question": "Must Step 22 happen after Step 4?", "why_question": "Why must Step 22 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 22, sifting icing sugar over the cake, is a decorative step that can be done after the cake has completely cooled, regardless of when Step 4, microwaving the chocolate mixture, is completed."}
{"plan_idx": 112, "title": "strawberries-in-pimm-s", "question_idx": 112, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6, garnishing with mint leaves, is an optional step and can be done at any time after the strawberries have been infused with the Pimm's in step 5."}
{"plan_idx": 113, "title": "chocolate-chocolate-cake", "question_idx": 113, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 20], "binary_question": "Must Step 21 happen after Step 3?", "why_question": "Why must Step 21 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Removing the cake from the tin after 10 minutes allows it to set, while allowing it to cool completely before sifting icing sugar over it for decoration ensures that the icing sugar doesn't melt."}
{"plan_idx": 114, "title": "very-vanilla-ry-cheesecake", "question_idx": 114, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, the steps can be done in any order as long as the cake is preheated and the crumbs are added before the cream cheese mixture."}
{"plan_idx": 115, "title": "brown sugar shortbread", "question_idx": 115, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why must Step 9 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 9 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not have to happen after Step 3; it should happen after Step 7."}
{"plan_idx": 116, "title": "very-vanilla-ry-cheesecake", "question_idx": 116, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 13 happen after Step 6?", "why_question": "Why must Step 13 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 13 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not depend on or is not affected by Step 6 in any way, so it does not have to happen after Step 6."}
{"plan_idx": 117, "title": "chicken and vegetable pie", "question_idx": 117, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 13], "binary_question": "Must Step 14 happen after Step 7?", "why_question": "Why must Step 14 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 14 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 (cutting slits in the pastry) should happen after Step 15 (baking the pie)."}
{"plan_idx": 118, "title": "spiced-pumpkin-teabread", "question_idx": 118, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The dry ingredients (flour, allspice) must be sifted before rubbing in the butter (Step 7) to ensure an even distribution and to prevent lumps in the mixture."}
{"plan_idx": 119, "title": "no-sugar-rock-cakes", "question_idx": 119, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 (bake for 20 minutes) must happen after Step 7 (place balls of dough on the baking tray) because the dough balls need to be placed on the tray before they can be baked."}
{"plan_idx": 120, "title": "spiced-pumpkin-teabread", "question_idx": 120, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 13], "binary_question": "Must Step 14 happen after Step 3?", "why_question": "Why must Step 14 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 14 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 does not require Step 3 to have been completed first, as it involves brushing the teabread with honey after baking."}
{"plan_idx": 121, "title": "chocolate-chocolate-cake", "question_idx": 121, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 must happen after Step 6 because it requires the mixture from Step 6 to be beaten together with the egg yolks."}
{"plan_idx": 122, "title": "vegetable-terrine", "question_idx": 122, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why must Step 11 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 11 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 4 is for preparing sorrel, while Step 11 is for arranging the vegetables in the mould, so it is not necessary for Step 11 to happen after Step 4."}
{"plan_idx": 123, "title": "chicken-prawn-and-rice-soup", "question_idx": 123, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 (Bring to the boil) should happen after Step 5 (Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans)."}
{"plan_idx": 124, "title": "very-vanilla-ry-cheesecake", "question_idx": 124, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 12 happen after Step 3?", "why_question": "Why must Step 12 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 12 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not depend on Step 3, as it involves cooling the cheesecake after it has been baked."}
{"plan_idx": 125, "title": "fusilli-and-meatballs", "question_idx": 125, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 20], "binary_question": "Must Step 21 happen after Step 13?", "why_question": "Why must Step 21 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 21 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 21 (serving the meatballs and remaining sauce over the pasta) does not require Step 13 (shaping the meat mixture into meatballs) to be completed first."}
{"plan_idx": 126, "title": "curried bbq mussels", "question_idx": 126, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (discarding unopened mussels) does not depend on the completion of Step 2 (whisking together the curry mixture)."}
{"plan_idx": 127, "title": "banana-split-cake", "question_idx": 127, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 (baking the base) must happen after Step 2 (preparing the base) because you need to put the prepared base in the oven to bake it."}
{"plan_idx": 128, "title": "balsamic-and-mozzarella-chicken", "question_idx": 128, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not depend on Step 1 because the subsequent steps do not require the chicken to be marinated."}
{"plan_idx": 129, "title": "tortellini-fritto-with-almond-butter", "question_idx": 129, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 requires olive oil, which is heated in Step 1."}
{"plan_idx": 130, "title": "balsamic-and-mozzarella-chicken", "question_idx": 130, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not depend on Step 3, as it involves placing mozzarella on the chicken after it has been cooked."}
{"plan_idx": 131, "title": "strawberry-tiramisu-trifle", "question_idx": 131, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 requires the assembly of the trifle in a glass bowl before refrigerating, whereas Step 6 refers to lining the bowl with soaked sponge fingers."}
{"plan_idx": 132, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 132, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not have to happen after Step 5 because the almonds can be sprinkled or rolled on the spinach rolls before they are wrapped in the cheese mix."}
{"plan_idx": 133, "title": "vegetable-terrine", "question_idx": 133, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Steps 5 and 6 are sequential as bringing cream and yogurt to the boil precedes adding the chopped sorrel and gelatin."}
{"plan_idx": 134, "title": "brown sugar shortbread", "question_idx": 134, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 6-9 should happen before step 10."}
{"plan_idx": 135, "title": "vegetable-terrine", "question_idx": 135, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why must Step 12 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 12 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not need to happen after Step 5 because the cream mixture is meant to be cooked before pouring it over the arranged vegetables."}
{"plan_idx": 136, "title": "fusilli-and-meatballs", "question_idx": 136, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 instructs to add basil and oregano to the tomato sauce, which is added to the saucepan in Step 6 and brought to a boil over medium-high heat in Step 7, so Step 10 must happen after the heat is reduced to medium-low in Step 8."}
{"plan_idx": 137, "title": "lightly spiced tomato and red lentil soup", "question_idx": 137, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 12 happen after Step 11?", "why_question": "Why must Step 12 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 12 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 involves serving the soup, which should be done after Step 11, when it is ready to be eaten."}
{"plan_idx": 138, "title": "tangy-gammon-in-cider", "question_idx": 138, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not depend on Step 3 and can be performed independently."}
{"plan_idx": 139, "title": "vegetable-terrine", "question_idx": 139, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 14 happen after Step 4?", "why_question": "Why must Step 14 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 14 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 is only necessary if a silicone mould is not used."}
{"plan_idx": 140, "title": "chocolate-chocolate-cake", "question_idx": 140, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 16], "binary_question": "Must Step 17 happen after Step 13?", "why_question": "Why must Step 17 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 17, baking the cake for an hour, can happen before or after Step 13, folding the egg white mixture into the chocolate mixture."}
{"plan_idx": 141, "title": "spiced-pumpkin-teabread", "question_idx": 141, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 12 happen after Step 4?", "why_question": "Why must Step 12 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 12 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not depend on the completion of Step 4 and can be performed after any step in the procedure."}
{"plan_idx": 142, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 142, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2:  Step 7 does not require any grapefruit skin or segments, so it does not need to happen after Step 1."}
{"plan_idx": 143, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 143, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 15], "binary_question": "Must Step 16 happen after Step 12?", "why_question": "Why must Step 16 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 16 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 involves whipping the cream, which is used in Step 15 to assemble the shortcakes, while Step 16 is the final step of assembling the shortcakes."}
{"plan_idx": 144, "title": "one-pot irish stew", "question_idx": 144, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not depend on Step 4; it can occur after any step prior to serving."}
{"plan_idx": 145, "title": "chocolate-chocolate-cake", "question_idx": 145, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 21], "binary_question": "Must Step 22 happen after Step 5?", "why_question": "Why must Step 22 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 22 is sifting icing sugar over the cake for decoration, which can be done any time after the cake has cooled completely."}
{"plan_idx": 146, "title": "simple-basic-cupcakes", "question_idx": 146, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 (letting the cake rest and cool) should happen after Step 7 (baking the cake)."}
{"plan_idx": 147, "title": "spiced-pumpkin-teabread", "question_idx": 147, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (Baking the bread) logically follows Step 10 (preparing the bread for baking) and occurs before Step 12 (cooling the bread), so it does not need to happen after Step 6."}
{"plan_idx": 148, "title": "chocolate-chocolate-cake", "question_idx": 148, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 12], "binary_question": "Must Step 13 happen after Step 5?", "why_question": "Why must Step 13 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 13 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 specifies that the chocolate mixture should be set aside to cool before being added to the mix in Step 10, and Step 13 comes after Step 10."}
{"plan_idx": 149, "title": "banana-split-cake", "question_idx": 149, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The bananas need to be sliced and arranged on the filling before the pineapple can be added in Step 10."}
{"plan_idx": 150, "title": "chicken and vegetable pie", "question_idx": 150, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 15], "binary_question": "Must Step 16 happen after Step 4?", "why_question": "Why must Step 16 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 16 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16, cooling the pie for 10 minutes before serving, does not need to happen after Step 4, as it is the final step in the procedure."}
{"plan_idx": 151, "title": "chicken and vegetable pie", "question_idx": 151, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 must happen after Step 5 because the roux (flour and butter mixture) must be cooked and thickened before the liquids are added."}
{"plan_idx": 152, "title": "tangy-gammon-in-cider", "question_idx": 152, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The tomatoes need to be softened in boiling water before the skins can be removed."}
{"plan_idx": 153, "title": "cloud-bread", "question_idx": 153, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not depend on Step 4 and can be performed after any of the other steps."}
{"plan_idx": 154, "title": "one-pot irish stew", "question_idx": 154, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 2 involves skimming off white fat that comes to the surface, which is only possible after the lamb has been boiled in Step 1."}
{"plan_idx": 155, "title": "tangy-gammon-in-cider", "question_idx": 155, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 requires chopped tomatoes and onions which are prepared in Steps 2 and 3."}
{"plan_idx": 156, "title": "fusilli-and-meatballs", "question_idx": 156, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 14], "binary_question": "Must Step 15 happen after Step 3?", "why_question": "Why must Step 15 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 15 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 can happen after any of the steps after Step 5."}
{"plan_idx": 157, "title": "butternut-squash-pastry-for-pies", "question_idx": 157, "steps": ["Place the flour, egg and squash into the container of a food processor.", "Pulse until mixed into a doughy ball.", "You may need to add a little extra flour.", "Divide into two equal parts.", "Use in a pie or pastie recipe."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: butternut-squash-pastry-for-pies\n\nProcedure:\n1. Place the flour, egg and squash into the container of a food processor.\n2. Pulse until mixed into a doughy ball.\n3. You may need to add a little extra flour.\n4. Divide into two equal parts.\n5. Use in a pie or pastie recipe.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 (use in a pie or pastie recipe) does not have to happen after Step 3 (divide into two equal parts) as the dough can be divided before it is used."}
{"plan_idx": 158, "title": "white bread", "question_idx": 158, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 2 and 4 do not have to be done in a particular order."}
{"plan_idx": 159, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 159, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not depend on Step 7 and can happen before or after it."}
{"plan_idx": 160, "title": "no-sugar-rock-cakes", "question_idx": 160, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Baking the rock cakes (Step 8) must occur before removing them from the oven and placing them on the cooling tray (Step 9)."}
{"plan_idx": 161, "title": "tomato and basil salad", "question_idx": 161, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 4 does not depend on Step 3 and can happen before or after it."}
{"plan_idx": 162, "title": "fusilli-and-meatballs", "question_idx": 162, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [13, 20], "binary_question": "Must Step 21 happen after Step 14?", "why_question": "Why must Step 21 happen after Step 14?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 21 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 21 does not depend on Step 14 and can happen at any time after Step 18."}
{"plan_idx": 163, "title": "spiced-pumpkin-teabread", "question_idx": 163, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 12 happen after Step 8?", "why_question": "Why must Step 12 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 12 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 9 (Tipping the mixture into the prepared tin and smoothing the surface) must happen before Step 12 (Allowing the loaf to cool in the tin)."}
{"plan_idx": 164, "title": "no-sugar-rock-cakes", "question_idx": 164, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 must happen after Step 6 because the balls of dough can only be placed onto the baking tray after they have been formed, which is done in Step 6."}
{"plan_idx": 165, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 165, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 should happen after Step 6, where the dough is divided in half."}
{"plan_idx": 166, "title": "lightly spiced tomato and red lentil soup", "question_idx": 166, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 12 happen after Step 4?", "why_question": "Why must Step 12 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 12 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 is serving the soup which is the last step in the procedure."}
{"plan_idx": 167, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 167, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 requires the shortcakes to be baked, which occurs after Step 7."}
{"plan_idx": 168, "title": "brown sugar shortbread", "question_idx": 168, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 must happen after Step 6 because the dough needs to be kneaded before it can be rolled."}
{"plan_idx": 169, "title": "spiced-pumpkin-teabread", "question_idx": 169, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 11], "binary_question": "Must Step 12 happen after Step 10?", "why_question": "Why must Step 12 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 12 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not have to happen after Step 10 as Step 11 (baking) comes after Step 10 (sprinkling with pumpkin seeds)."}
{"plan_idx": 170, "title": "banana-split-cake", "question_idx": 170, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (Cover with whipped cream) can happen at any point in the procedure after Step 8 (Spread over cooled base)."}
{"plan_idx": 171, "title": "lightly spiced tomato and red lentil soup", "question_idx": 171, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: The procedure shows that Step 9 should happen after Step 8, not Step 1."}
{"plan_idx": 172, "title": "scone-pastry", "question_idx": 172, "steps": ["Sift the flour, baking powder and salt into a bowl.", "Add the butter and rub in until the mixture resembles fine crumbs.", "Make a well in the centre and add the milk.", "Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.", "Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: scone-pastry\n\nProcedure:\n1. Sift the flour, baking powder and salt into a bowl.\n2. Add the butter and rub in until the mixture resembles fine crumbs.\n3. Make a well in the centre and add the milk.\n4. Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.\n5. Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The sifted dry ingredients in Step 1 need to be coated in the butter before the milk can be added in Step 3"}
{"plan_idx": 173, "title": "spiced-pumpkin-teabread", "question_idx": 173, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Flour mixture needs to be sifted before the pumpkin mixture can be added and beaten with the wooden spoon in Step 8."}
{"plan_idx": 174, "title": "chocolate-chocolate-cake", "question_idx": 174, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 requires the cooled chocolate, which is created in Step 7."}
{"plan_idx": 175, "title": "slow cooker butter chicken", "question_idx": 175, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not require the completion of Step 3 for it to be performed."}
{"plan_idx": 176, "title": "tangy-gammon-in-cider", "question_idx": 176, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not need to happen after Step 6, as the pouring of cider can be done at any point after the gammon steaks have been placed in the dish."}
{"plan_idx": 177, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 177, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 must happen after Step 2 because the cream cheese, feta, sundried tomatoes, basil and garlic must be mixed together before they can be stirred until creamy with no lumps."}
{"plan_idx": 178, "title": "spicy-tomato-anchovy-pasta", "question_idx": 178, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not have to happen after Step 5 because it can be done at any point after the anchovy mixture and chilli flakes have been added in Step 8."}
{"plan_idx": 179, "title": "spiced butternut squash soup", "question_idx": 179, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why must Step 11 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (cook potatoes for 20 mins) can happen before or after step 9 (pour chicken stock into the pot) as long as step 10 (bring to the boil) happens after both."}
{"plan_idx": 180, "title": "chocolate-chocolate-cake", "question_idx": 180, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, step 10 (adding the cooled chocolate to the mix) should happen after step 9 (adding the flour), because the flour needs to be mixed in before the chocolate is added."}
{"plan_idx": 181, "title": "slow cooker butter chicken", "question_idx": 181, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Steps 6 and 7 are dependent on the sauce being in the slow cooker, which is a result of Step 5."}
{"plan_idx": 182, "title": "vegetable-terrine", "question_idx": 182, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 13], "binary_question": "Must Step 14 happen after Step 11?", "why_question": "Why must Step 14 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 14 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 14 is the step to unmold the terrine, and it must happen after the terrine has been refrigerated and set (Step 13)."}
{"plan_idx": 183, "title": "spiced-pumpkin-teabread", "question_idx": 183, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 12 happen after Step 1?", "why_question": "Why must Step 12 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 12 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not occur after Step 1 but actually happens after Step 11."}
{"plan_idx": 184, "title": "spiced-pumpkin-teabread", "question_idx": 184, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 involves preparing the dry ingredients, while Step 9 requires adding the wet ingredients to the dry ingredients, so Step 9 must happen after Step 7."}
{"plan_idx": 185, "title": "strawberries-in-pimm-s", "question_idx": 185, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 is not dependent on Step 1 and can happen at any time after Step 5."}
{"plan_idx": 186, "title": "chocolate-pancake-batter", "question_idx": 186, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not require the pan to be heated, so it does not need to happen after Step 5."}
{"plan_idx": 187, "title": "spiced-pumpkin-teabread", "question_idx": 187, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 13], "binary_question": "Must Step 14 happen after Step 1?", "why_question": "Why must Step 14 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 14 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The teabread is to be brushed with honey while still warm, so Step 14 must happen after Step 1."}
{"plan_idx": 188, "title": "very-vanilla-ry-cheesecake", "question_idx": 188, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 can happen after Step 4 as the crumb mixture is ready at that stage."}
{"plan_idx": 189, "title": "spiced butternut squash soup", "question_idx": 189, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 12 happen after Step 11?", "why_question": "Why must Step 12 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 12 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 (adding the squash and mashing with the potatoes) must occur after Step 11 (cooking the potatoes and squash until soft) because the potatoes and squash need to be soft before they can be mashed together."}
{"plan_idx": 190, "title": "strawberry-tiramisu-trifle", "question_idx": 190, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 directs the user to line the bowl with one layer of sponge fingers, and Step 8 directs the user to repeat the layers in order, which means that Step 8 must happen after Step 5."}
{"plan_idx": 191, "title": "sardine spread", "question_idx": 191, "steps": ["Place the sardines in a bowl and roughly mash with a fork.", "Add in all of the remaining ingredients and stir well.", "Enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: sardine spread\n\nProcedure:\n1. Place the sardines in a bowl and roughly mash with a fork.\n2. Add in all of the remaining ingredients and stir well.\n3. Enjoy!\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 2 must happen after Step 1 because the sardines need to be mashed before the other ingredients can be added."}
{"plan_idx": 192, "title": "chicken-prawn-and-rice-soup", "question_idx": 192, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 must happen after Step 1 because the prawns and chicken mixture needs to be made before it can be cooked."}
{"plan_idx": 193, "title": "fusilli-and-meatballs", "question_idx": 193, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 19], "binary_question": "Must Step 20 happen after Step 3?", "why_question": "Why must Step 20 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 20 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 20 does not have to happen after Step 3, as it follows Steps 19 and 20 in the procedure."}
{"plan_idx": 194, "title": "black-rice-pudding", "question_idx": 194, "steps": ["Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.", "Bring to the boil over high heat, stirring frequently.", "Reduce heat to medium-low.", "Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.", "Stir in coconut cream and vanilla extract.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: black-rice-pudding\n\nProcedure:\n1. Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.\n2. Bring to the boil over high heat, stirring frequently.\n3. Reduce heat to medium-low.\n4. Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.\n5. Stir in coconut cream and vanilla extract.\n6. Serve warm.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 1 includes rinsing and draining the rice, while Step 5 involves stirring in coconut cream and vanilla extract after the rice is cooked. These steps are independent of each other and can be performed in any order."}
{"plan_idx": 195, "title": "white bread", "question_idx": 195, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: No\nAnswer 2: There is no specific order between Step 1 and Step 7 in the procedure."}
{"plan_idx": 196, "title": "almond and apple cake", "question_idx": 196, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The procedure specifies that half the flour and half the milk should be added before the remaining flour and milk, so Step 9 must happen after Step 6."}
{"plan_idx": 197, "title": "chocolate-pancake-batter", "question_idx": 197, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (turning out the pan and repeating with remaining batter) does not have to happen after Step 3 (gradually whisk in milk, melted butter and sugar)."}
{"plan_idx": 198, "title": "balsamic-and-mozzarella-chicken", "question_idx": 198, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 (arranging the chicken on a serving platter) must happen after Step 5 (sauteing the chicken fillets) because the chicken needs to be cooked before it can be arranged on a platter."}
{"plan_idx": 199, "title": "chicken and vegetable pie", "question_idx": 199, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 involves creating the liquid mixture, which Step 9 requires for thickening."}
{"plan_idx": 200, "title": "chocolate-chocolate-cake", "question_idx": 200, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 21], "binary_question": "Must Step 22 happen after Step 8?", "why_question": "Why must Step 22 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: No\nAnswer 2: Step 22 (sifting icing sugar over the top for decoration) is not dependent on Step 8 (beating in egg yolks one at a time) and can be done after any step in the procedure."}
{"plan_idx": 201, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 201, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 calls for kneading the dough 10 times, and Step 6 involves dividing the dough in half, which would be difficult to do if the dough had not been kneaded."}
{"plan_idx": 202, "title": "white bread", "question_idx": 202, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 12 happen after Step 7?", "why_question": "Why must Step 12 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 12 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 involves allowing the dough to rise after it has been divided and shaped into loaves, which should happen after step 10 not step 7."}
{"plan_idx": 203, "title": "spiced butternut squash soup", "question_idx": 203, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [13, 14], "binary_question": "Must Step 15 happen after Step 14?", "why_question": "Why must Step 15 happen after Step 14?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 15 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The soup is pureed in Step 13 which is before it is seasoned in Step 15."}
{"plan_idx": 204, "title": "chicken-prawn-and-rice-soup", "question_idx": 204, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 must happen after Step 5 because the ingredients have to be placed in the pot before salt and sherry can be added."}
{"plan_idx": 205, "title": "spiced butternut squash soup", "question_idx": 205, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 15], "binary_question": "Must Step 16 happen after Step 11?", "why_question": "Why must Step 16 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 16 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16, heating through the soup, does not have to happen after Step 11, adding the squash and potatoes, because other steps occur in between."}
{"plan_idx": 206, "title": "cranachan", "question_idx": 206, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 (Spoon into 4 serving bowls) must happen after Step 6 (Whip the cream to firm peaks) because whipped cream is one of the main ingredients in cranachan."}
{"plan_idx": 207, "title": "jam-drop-biscuits", "question_idx": 207, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 must happen after Step 5 because the holes in the balls need to be created before the jam can be filled in."}
{"plan_idx": 208, "title": "cranachan", "question_idx": 208, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (garnishing with a mint leaf) does not depend on Step 5 (removing the toasted oats from the tray for faster cooling)."}
{"plan_idx": 209, "title": "chocolate-chocolate-cake", "question_idx": 209, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [14, 16], "binary_question": "Must Step 17 happen after Step 15?", "why_question": "Why must Step 17 happen after Step 15?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 15?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 15 involves wrapping the bottom of the cake tin securely in greaseproof paper or foil, which would make it difficult to pour the mixture into the cake tin (Step 17) if it were done after."}
{"plan_idx": 210, "title": "simple-basic-cupcakes", "question_idx": 210, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, Step 10 does not have to happen after Step 7, as the cupcakes can be cooled without decorating them."}
{"plan_idx": 211, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 211, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not depend on Step 3 and can happen at any time after Step 6."}
{"plan_idx": 212, "title": "white bread", "question_idx": 212, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why must Step 8 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 8 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The dough needs to be covered with a damp cloth (step 7) in order to rise properly (step 8)."}
{"plan_idx": 213, "title": "jam-drop-biscuits", "question_idx": 213, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 involves filling the biscuit holes with jam and baking, which must be done after the biscuits have been formed and chilled in Step 3."}
{"plan_idx": 214, "title": "lightly spiced tomato and red lentil soup", "question_idx": 214, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why must Step 11 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 11 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: To ensure that the soup is seasoned to taste after it has been blended."}
{"plan_idx": 215, "title": "spiced butternut squash soup", "question_idx": 215, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 16], "binary_question": "Must Step 17 happen after Step 2?", "why_question": "Why must Step 17 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 17 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 17 (serving the soup) does not need to happen after Step 2 (placing the squash halves cut side down on a dish)."}
{"plan_idx": 216, "title": "very-vanilla-ry-cheesecake", "question_idx": 216, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 12 happen after Step 2?", "why_question": "Why must Step 12 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 12 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 involves cooling the cheesecake down in the oven after it has been baked, which does not depend on the completion of Step 2, which involves crushing biscuits."}
{"plan_idx": 217, "title": "chocolate-chocolate-cake", "question_idx": 217, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 15], "binary_question": "Must Step 16 happen after Step 8?", "why_question": "Why must Step 16 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 16 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16 does not depend on Step 8 (greasing the cake tin) as the cake mixture is not yet ready."}
{"plan_idx": 218, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 218, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not depend on Step 4 and can be performed at any time after Step 8."}
{"plan_idx": 219, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 219, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 14], "binary_question": "Must Step 15 happen after Step 7?", "why_question": "Why must Step 15 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 15 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 15 does not need to happen after Step 7 because Steps 8-14 need to be completed before assembling the shortcakes in Step 15."}
{"plan_idx": 220, "title": "chocolate-chocolate-cake", "question_idx": 220, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 13 happen after Step 6?", "why_question": "Why must Step 13 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 13 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 must happen after Step 11 and Step 12, not after Step 6."}
{"plan_idx": 221, "title": "chicken-prawn-and-rice-soup", "question_idx": 221, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why must Step 12 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 12 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Because the soup must contain rice and the rice is added in Step 12."}
{"plan_idx": 222, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 222, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 (blanching the spinach leaves) must be completed before Step 5 (wrapping the cheese mix in the spinach leaves) as the leaves need to be softened before they can be wrapped."}
{"plan_idx": 223, "title": "chocolate-chocolate-cake", "question_idx": 223, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The chocolate mixture needs to be cooled before adding it to the batter, so Step 10 must happen after Step 2."}
{"plan_idx": 224, "title": "chocolate-chocolate-cake", "question_idx": 224, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 (Setting aside the chocolate mixture to cool) must happen after Step 3 (Melting the chocolate in the microwave) to allow the mixture to cool down before adding it to the batter."}
{"plan_idx": 225, "title": "curried bbq mussels", "question_idx": 225, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 (sprinkling the red pepper and parsley over the top of each portion) must happen after Step 5 (dotting the mussels with the curry mixture) because the spices need to be applied on top of the curry mixture."}
{"plan_idx": 226, "title": "spicy-tomato-anchovy-pasta", "question_idx": 226, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 (serving immediately) must happen after Step 7 (draining the linguine) because the linguine needs to be cooked and drained before it can be tossed with the anchovy mixture and served."}
{"plan_idx": 227, "title": "slow cooker butter chicken", "question_idx": 227, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not have to happen after Step 2 because the procedure does not specify that it must."}
{"plan_idx": 228, "title": "spicy-tomato-anchovy-pasta", "question_idx": 228, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 can happen after any step in the procedure."}
{"plan_idx": 229, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 229, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 13], "binary_question": "Must Step 14 happen after Step 2?", "why_question": "Why must Step 14 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 14 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Splitting the shortcakes in half (step 14) can happen before or after combining the flour, sugar, baking powder and salt (step 2) because these steps are independent of each other."}
{"plan_idx": 230, "title": "chocolate-chocolate-cake", "question_idx": 230, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 20], "binary_question": "Must Step 21 happen after Step 7?", "why_question": "Why must Step 21 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 21 involves allowing the cake to cool completely after it has been removed from the tin, which is not necessary after Step 7."}
{"plan_idx": 231, "title": "creamy-chayote-squash-soup", "question_idx": 231, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not depend on Step 4 and can be done at any time after Step 8."}
{"plan_idx": 232, "title": "easy strawberry tart", "question_idx": 232, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 pouring the filling into the tart base should happen after Step 4 where the strawberries are coated."}
{"plan_idx": 233, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 233, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 15], "binary_question": "Must Step 16 happen after Step 6?", "why_question": "Why must Step 16 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 16 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 16 involves assembling the shortcakes, which requires the components to be prepared first, hence it must happen after Step 6."}
{"plan_idx": 234, "title": "fusilli-and-meatballs", "question_idx": 234, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 13 happen after Step 4?", "why_question": "Why must Step 13 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 requires onion mixture from the saucepan, which is obtained after Step 4."}
{"plan_idx": 235, "title": "brown sugar shortbread", "question_idx": 235, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: In order to create a soft dough, flour must be added to the mixture of butter and sugar."}
{"plan_idx": 236, "title": "chocolate-chocolate-cake", "question_idx": 236, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 16], "binary_question": "Must Step 17 happen after Step 12?", "why_question": "Why must Step 17 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 17 (bake for 1 hour) does not depend on Step 12 (beat egg whites until stiff) being completed first."}
{"plan_idx": 237, "title": "almond and apple cake", "question_idx": 237, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 must happen after Step 4 because the dry ingredients (flour and almonds) cannot be added to the wet ingredients (butter, sugar, eggs, milk) until the wet ingredients are properly combined."}
{"plan_idx": 238, "title": "almond and apple cake", "question_idx": 238, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why must Step 11 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 11 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 must happen after Step 10, as it requires the arrangement of apples over the base of the tin."}
{"plan_idx": 239, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 239, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 can be done after Step 8 because the ingredients added in Steps 5, 6 and 7 do not need to be cooked with the peppers and tuna."}
{"plan_idx": 240, "title": "spiced butternut squash soup", "question_idx": 240, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 13], "binary_question": "Must Step 14 happen after Step 10?", "why_question": "Why must Step 14 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 14 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 (Return to the pot) can happen after any of the steps 11-13, as they all involve adding ingredients to the pot."}
{"plan_idx": 241, "title": "rouille", "question_idx": 241, "steps": ["In a mortar, crush the garlic to a fine mash.", "Transfer to a mixing bowl.", "Add the egg yolks, and beat into a mayonnaise while adding the olive oil.", "When the sauce is thick and smooth, stir in the cayenne pepper and saffron."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: rouille\n\nProcedure:\n1. In a mortar, crush the garlic to a fine mash.\n2. Transfer to a mixing bowl.\n3. Add the egg yolks, and beat into a mayonnaise while adding the olive oil.\n4. When the sauce is thick and smooth, stir in the cayenne pepper and saffron.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 must happen after Step 3 because the mayonnaise has to be made before the cayenne pepper and saffron can be stirred in."}
{"plan_idx": 242, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 242, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 involves adding tuna to the mixture, which can be done at any point after the peppers are added in Step 8."}
{"plan_idx": 243, "title": "lightly spiced tomato and red lentil soup", "question_idx": 243, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 does not depend on Step 2 and can be done at any time after Step 6."}
{"plan_idx": 244, "title": "banana-split-cake", "question_idx": 244, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The oven must be preheated before the cake base can be baked."}
{"plan_idx": 245, "title": "one-pot irish stew", "question_idx": 245, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 must happen after Step 1 because the potatoes need to be cooked for 30 minutes before being broken up and stirred into the stew."}
{"plan_idx": 246, "title": "almond and apple cake", "question_idx": 246, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 13], "binary_question": "Must Step 14 happen after Step 6?", "why_question": "Why must Step 14 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 14 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 14 involves serving the cake warm, which should be done after it has been baked and cooled slightly (Steps 12 and 13)."}
{"plan_idx": 247, "title": "chicken and vegetable pie", "question_idx": 247, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 14], "binary_question": "Must Step 15 happen after Step 9?", "why_question": "Why must Step 15 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 15 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 15 (baking the pie) must happen after Step 9 (setting the liquid mixture aside) because the liquid mixture needs to be poured over the chicken mixture before it can be baked."}
{"plan_idx": 248, "title": "chicken and vegetable pie", "question_idx": 248, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why must Step 8 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 8 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 involves slowly stirring in chicken stock and milk to create the liquid mixture, which must then be simmered over medium-low heat in Step 8 until thick."}
{"plan_idx": 249, "title": "spicy-tomato-anchovy-pasta", "question_idx": 249, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 (season with black pepper) is optional, so Step 10 (serve immediately) can happen regardless of whether Step 9 is performed."}
{"plan_idx": 250, "title": "one-pot irish stew", "question_idx": 250, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not depend on Step 1 and can happen after any step in the procedure."}
{"plan_idx": 251, "title": "chicken and vegetable pie", "question_idx": 251, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 14 happen after Step 5?", "why_question": "Why must Step 14 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 14 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 does not depend on Step 5 since it involves making slits for steam release in the pastry, which is a final step in preparing the pie."}
{"plan_idx": 252, "title": "spiced butternut squash soup", "question_idx": 252, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 14], "binary_question": "Must Step 15 happen after Step 12?", "why_question": "Why must Step 15 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 15 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 involves mashing the squash and potatoes, while step 15 involves seasoning the soup, so they can be done in any order."}
{"plan_idx": 253, "title": "chocolate-chocolate-cake", "question_idx": 253, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 15], "binary_question": "Must Step 16 happen after Step 6?", "why_question": "Why must Step 16 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 16 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: The cake must be fully prepared before it is poured into the cake tin in Step 16."}
{"plan_idx": 254, "title": "vegetable-terrine", "question_idx": 254, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 14], "binary_question": "Must Step 15 happen after Step 9?", "why_question": "Why must Step 15 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 15 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 does not have to happen after Step 9, as the terrine needs to be refrigerated for several hours in Step 13."}
{"plan_idx": 255, "title": "vegetable-terrine", "question_idx": 255, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 (pouring approximately 1cm of the cream mixture into a mould and refrigerating it) does not have to happen after Step 1 (adding the gelatin to a bowl of cold water until soft) because the gelatin needs to be heated in the stock with the vegetables in Step 2 before it can be added to the cream and yogurt in Step 5."}
{"plan_idx": 256, "title": "fusilli-and-meatballs", "question_idx": 256, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [15, 17], "binary_question": "Must Step 18 happen after Step 16?", "why_question": "Why must Step 18 happen after Step 16?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 18 happen after Step 16?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 18 (Cooking the meatballs in the tomato sauce) should happen after Step 16 (Draining the meatballs after browning) so that the meatballs can fully absorb the flavors of the sauce."}
{"plan_idx": 257, "title": "easy strawberry tart", "question_idx": 257, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 must happen after step 4, as per the instructions."}
{"plan_idx": 258, "title": "no-sugar-rock-cakes", "question_idx": 258, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why must Step 8 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 8 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 must happen after Step 7 because the balls of dough must be placed on the baking tray before they can be baked."}
{"plan_idx": 259, "title": "slow cooker butter chicken", "question_idx": 259, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: You must season the dish after adding all the other ingredients so that the flavors are well blended."}
{"plan_idx": 260, "title": "balsamic-and-mozzarella-chicken", "question_idx": 260, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 (placing a leaf of basil on top of the cheese) must happen after Step 5 (sauteing the chicken breast fillets) because the chicken must be cooked before the basil can be added."}
{"plan_idx": 261, "title": "chicken and vegetable pie", "question_idx": 261, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 12 happen after Step 7?", "why_question": "Why must Step 12 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 12 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 involves pouring the hot liquid mixture over the chicken mixture, which is prepared in Step 4 and Step 11. Therefore, Step 12 must happen after Step 7."}
{"plan_idx": 262, "title": "shellabina-s-corned-beef-hash", "question_idx": 262, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 cannot happen before Step 5 because the stew must thicken up before it is ready to serve."}
{"plan_idx": 263, "title": "spiced butternut squash soup", "question_idx": 263, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 9 must happen after Step 7 because the chicken stock needs to be added to the melted butter before the other ingredients are added."}
{"plan_idx": 264, "title": "white bread", "question_idx": 264, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The dough must be punched down (Step 9) and kneaded (Step 10) before shaping and rising (Steps 11-12)."}
{"plan_idx": 265, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 265, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: It is not necessary to complete step 2 before completing step 8."}
{"plan_idx": 266, "title": "fusilli-and-meatballs", "question_idx": 266, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 20], "binary_question": "Must Step 21 happen after Step 11?", "why_question": "Why must Step 21 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 21 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 is to process the bread into crumbs, which is used in step 12 for the meatballs, while step 21 is spooning the meatballs and remaining sauce over the top of the cooked pasta."}
{"plan_idx": 267, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 267, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not have to happen after Step 2 because Steps 3, 4 and 5 must be completed first."}
{"plan_idx": 268, "title": "chicken-prawn-and-rice-soup", "question_idx": 268, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 12], "binary_question": "Must Step 13 happen after Step 2?", "why_question": "Why must Step 13 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 13 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not depend on Step 2, so it does not have to happen after Step 2."}
{"plan_idx": 269, "title": "balsamic-and-mozzarella-chicken", "question_idx": 269, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 9 instructs drizzling balsamic vinegar over the platter, which can be done anytime after the chicken is cooked and arranged on the platter."}
{"plan_idx": 270, "title": "cranachan", "question_idx": 270, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 must happen after Step 1 because the toasted oats are used in Step 7."}
{"plan_idx": 271, "title": "tomato and basil salad", "question_idx": 271, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 4 (drizzling over the vinegar and oil) does not have to happen after Step 1 (grabbing an attractive serving plate); it can happen after Step 3 (sprinkling the basil leaves)."}
{"plan_idx": 272, "title": "scone-pastry", "question_idx": 272, "steps": ["Sift the flour, baking powder and salt into a bowl.", "Add the butter and rub in until the mixture resembles fine crumbs.", "Make a well in the centre and add the milk.", "Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.", "Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: scone-pastry\n\nProcedure:\n1. Sift the flour, baking powder and salt into a bowl.\n2. Add the butter and rub in until the mixture resembles fine crumbs.\n3. Make a well in the centre and add the milk.\n4. Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.\n5. Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Mixing the milk into the mixture (Step 3) must happen after rubbing the butter (Step 2) because it is the butter that gives the scone pastry its flaky texture."}
{"plan_idx": 273, "title": "creamy-chayote-squash-soup", "question_idx": 273, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 (pureeing the mixture) should happen after steps 3, 4, 5, 6, and 7  (cooking the onion, garlic, chillies, squash, and adding the stock, covering, and simmering the mixture)."}
{"plan_idx": 274, "title": "vegetable-terrine", "question_idx": 274, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 13], "binary_question": "Must Step 14 happen after Step 9?", "why_question": "Why must Step 14 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 14 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 is only necessary if the terrine is not made in a silicone mould."}
{"plan_idx": 275, "title": "green-tofu-curry", "question_idx": 275, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 12 happen after Step 11?", "why_question": "Why must Step 12 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 12 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 requires the mixture from Step 11 to be drizzled over the tofu and rice."}
{"plan_idx": 276, "title": "fusilli-and-meatballs", "question_idx": 276, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 14], "binary_question": "Must Step 15 happen after Step 13?", "why_question": "Why must Step 15 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 15 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 15 involves cooking the meatballs, which should be done after the meatballs are shaped in Step 13."}
{"plan_idx": 277, "title": "spiced-guava-cake", "question_idx": 277, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 (adding flour and guava mixture) requires the egg mixture from Step 6 to be complete."}
{"plan_idx": 278, "title": "cranachan", "question_idx": 278, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not have to happen after Step 2 because the oats need to cool before they can be removed from the tray."}
{"plan_idx": 279, "title": "chocolate-chocolate-cake", "question_idx": 279, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 17], "binary_question": "Must Step 18 happen after Step 6?", "why_question": "Why must Step 18 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 18 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 18 (checking if the cake is ready) cannot happen before Step 6 (beating butter and margarine together) because the cake batter has not been made yet."}
{"plan_idx": 280, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 280, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 6-8 must happen before Step 9 because they involve shaping and positioning the dough before baking."}
{"plan_idx": 281, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 281, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 8 involves mixing and pouring a dressing over the salad, which should be done after the salad is assembled in Step 6."}
{"plan_idx": 282, "title": "vegetable-terrine", "question_idx": 282, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 14], "binary_question": "Must Step 15 happen after Step 11?", "why_question": "Why must Step 15 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 15 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 15 must happen after Step 11 because it is necessary to refrigerate the terrine for several hours until firm before serving it chilled."}
{"plan_idx": 283, "title": "old-fashioned-welsh-rarebit", "question_idx": 283, "steps": ["Grate 250g well-flavoured mature Cheddar cheese (you can also use a good Double Gloucester or Shropshire) and put into a heavy-based medium-sized pan (preferably nonstick) with 10g butter, 1 tsp mustard (English, wholegrain or Dijon), plenty of ground black pepper and 4 tbsp ale or semi-skimmed milk.", "Set over a low heat and melt gently, stirring, until smooth and thick.", "Spoon onto 4 thick slices of toast and grill until browned and bubbling.", "Serve with grilled mushrooms and a leaf salad for a light lunch or snack."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: old-fashioned-welsh-rarebit\n\nProcedure:\n1. Grate 250g well-flavoured mature Cheddar cheese (you can also use a good Double Gloucester or Shropshire) and put into a heavy-based medium-sized pan (preferably nonstick) with 10g butter, 1 tsp mustard (English, wholegrain or Dijon), plenty of ground black pepper and 4 tbsp ale or semi-skimmed milk.\n2. Set over a low heat and melt gently, stirring, until smooth and thick.\n3. Spoon onto 4 thick slices of toast and grill until browned and bubbling.\n4. Serve with grilled mushrooms and a leaf salad for a light lunch or snack.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The procedure indicates that Step 3 should be performed after Step 2 has been completed, as the cheese mixture must be melted and thickened in Step 2 before it can be spooned onto toast and grilled in Step 3."}
{"plan_idx": 284, "title": "fusilli-and-meatballs", "question_idx": 284, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 19], "binary_question": "Must Step 20 happen after Step 6?", "why_question": "Why must Step 20 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 20 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Cooking the pasta and tossing it with the sauce can be done at any time during the process, so it does not have to happen after Step 6."}
{"plan_idx": 285, "title": "creamy-chayote-squash-soup", "question_idx": 285, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The stock must be added after the squash, coriander, salt, and pepper have been added to the saucepan and stirred continuously for 5 minutes."}
{"plan_idx": 286, "title": "very-vanilla-ry-cheesecake", "question_idx": 286, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 11 happen after Step 10?", "why_question": "Why must Step 11 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 11 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The cheesecake needs to be baked in a water bath, and the water bath needs to be in the oven before the cheesecake can be placed on the middle rack."}
{"plan_idx": 287, "title": "white bread", "question_idx": 287, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 can happen after any step in the procedure, except for steps 11 and 13."}
{"plan_idx": 288, "title": "spiced-pumpkin-teabread", "question_idx": 288, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 11], "binary_question": "Must Step 12 happen after Step 6?", "why_question": "Why must Step 12 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 12 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not depend on Step 6, as it involves letting the loaf cool after baking, which happens after Step 11."}
{"plan_idx": 289, "title": "spiced butternut squash soup", "question_idx": 289, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Roasting butternut squash tends to make its skin tough, and removing the skin after roasting is much easier than removing it before."}
{"plan_idx": 290, "title": "spiced butternut squash soup", "question_idx": 290, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4, baking the squash, must happen after Step 3, placing the squash in the baking dish, because the squash needs to be in the dish before it can be baked."}
{"plan_idx": 291, "title": "fusilli-and-meatballs", "question_idx": 291, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 16], "binary_question": "Must Step 17 happen after Step 13?", "why_question": "Why must Step 17 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 17 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The meatballs need to be browned before they are added to the sauce, so Step 17 must happen after Step 13."}
{"plan_idx": 292, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 292, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 9, which involves stirring in the tuna and parsley, must happen after Step 8."}
{"plan_idx": 293, "title": "white bread", "question_idx": 293, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 requires the dough to double in bulk, which requires the yeast to be active, which is done in Step 2."}
{"plan_idx": 294, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 294, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 2 (adding lentils and cooking them) must happen after Step 1 (bringing a large pan of water to the boil) because the lentils need to be cooked in boiling water."}
{"plan_idx": 295, "title": "almond and apple cake", "question_idx": 295, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The tin must be prepared with butter and baking parchment before the apples are arranged in it."}
{"plan_idx": 296, "title": "chocolate-chocolate-cake", "question_idx": 296, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 15], "binary_question": "Must Step 16 happen after Step 9?", "why_question": "Why must Step 16 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 16 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The cake batter is mixed in steps 6-10, then the egg white mixture is folded in (step 13), so the batter is ready to be poured into the cake tin (step 16) after step 13."}
{"plan_idx": 297, "title": "almond and apple cake", "question_idx": 297, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 13 happen after Step 4?", "why_question": "Why must Step 13 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 13 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not require the result of Step 4."}
{"plan_idx": 298, "title": "chocolate-pancake-batter", "question_idx": 298, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 10], "binary_question": "Must Step 11 happen after Step 9?", "why_question": "Why must Step 11 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 11 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Yes, because the pancakes need to be cooked before they can be stacked."}
{"plan_idx": 299, "title": "spiced butternut squash soup", "question_idx": 299, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [15, 16], "binary_question": "Must Step 17 happen after Step 16?", "why_question": "Why must Step 17 happen after Step 16?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 17 happen after Step 16?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: Yes\nAnswer 2: Step 17 involves serving the soup, which should be done after it has been heated through in Step 16."}
{"plan_idx": 300, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 300, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 requires using the flour from step 2 to rub the butter into to resemble coarse crumbs."}
{"plan_idx": 301, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 301, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 15], "binary_question": "Must Step 16 happen after Step 13?", "why_question": "Why must Step 16 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 16 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 involves beating the cream until stiff peaks form, which is necessary before assembling the shortcakes in Step 16."}
{"plan_idx": 302, "title": "chocolate-pancake-batter", "question_idx": 302, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 does not need to happen after Step 1, as it is meant to keep the pancakes warm after they have been cooked."}
{"plan_idx": 303, "title": "lightly spiced tomato and red lentil soup", "question_idx": 303, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 12 happen after Step 9?", "why_question": "Why must Step 12 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 12 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 instructs to serve the soup, which requires the soup to be blended in Step 9 before it can be served."}
{"plan_idx": 304, "title": "curried bbq mussels", "question_idx": 304, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why must Step 8 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 8 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 (wrapping the foil tightly around the portions) must happen after Step 7 (topping each portion with lime slices) to ensure the lime slices are enclosed in the packets for cooking."}
{"plan_idx": 305, "title": "no-sugar-rock-cakes", "question_idx": 305, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not have to happen after Step 3, as the order of mixing the ingredients is not crucial for the outcome."}
{"plan_idx": 306, "title": "chocolate-chocolate-cake", "question_idx": 306, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 15], "binary_question": "Must Step 16 happen after Step 10?", "why_question": "Why must Step 16 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 16 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Pouring the mixture into the cake tin must happen after the cake batter is complete, which occurs in Step 10."}
{"plan_idx": 307, "title": "almond and apple cake", "question_idx": 307, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, step 7 can happen before or after step 6 as the order does not matter."}
{"plan_idx": 308, "title": "spiced butternut squash soup", "question_idx": 308, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 12 happen after Step 1?", "why_question": "Why must Step 12 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 12 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 must occur after Step 5, as the squash needs to be cooled and peeled before it can be combined with the potatoes."}
{"plan_idx": 309, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 309, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 14], "binary_question": "Must Step 15 happen after Step 9?", "why_question": "Why must Step 15 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 15 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Only after the shortcakes are baked in Step 9 can they be split, spread with lemon butter, and topped with strawberries and whipped cream in Step 15."}
{"plan_idx": 310, "title": "spiced butternut squash soup", "question_idx": 310, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The squash needs to be cooled slightly before the peel can be easily removed, so Step 5 must happen after Step 4."}
{"plan_idx": 311, "title": "chocolate-chocolate-cake", "question_idx": 311, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 requires the chocolate mixture to be cooled, which is achieved in Step 3."}
{"plan_idx": 312, "title": "easy strawberry tart", "question_idx": 312, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 (Remove from heat) must happen after Step 1 (Mix together the sugar, water, jam and cornflour in a medium large saucepan) because the mixture must be heated to boiling in Step 2 (Boil for one minute) before it can be removed from heat in Step 3."}
{"plan_idx": 313, "title": "spiced butternut squash soup", "question_idx": 313, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 16], "binary_question": "Must Step 17 happen after Step 13?", "why_question": "Why must Step 17 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 17 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 14, 15, and 16 must happen after step 13 so that the soup can be seasoned, heated through, and ladled into bowls."}
{"plan_idx": 314, "title": "chicken and vegetable pie", "question_idx": 314, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 10], "binary_question": "Must Step 11 happen after Step 10?", "why_question": "Why must Step 11 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 11 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 11 requires a pie dish prepared by lining it with pastry, which is done in Step 10."}
{"plan_idx": 315, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 315, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 must happen after Step 4 because the mushrooms need to give up their juices before the other ingredients can be added."}
{"plan_idx": 316, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 316, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The dough needs to be kneaded before it can be shaped into circles."}
{"plan_idx": 317, "title": "chocolate-chocolate-cake", "question_idx": 317, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 20], "binary_question": "Must Step 21 happen after Step 12?", "why_question": "Why must Step 21 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 21 (cooling completely) can happen after any step in the procedure as long as the cake has been baked (step 17)."}
{"plan_idx": 318, "title": "shellabina-s-corned-beef-hash", "question_idx": 318, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not depend on the completion of Step 1 as it can be performed after any of the previous steps."}
{"plan_idx": 319, "title": "white bread", "question_idx": 319, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why must Step 12 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 12 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12, allowing the dough to rise in the loaf tins, should occur after Step 11, when the dough has been shaped into loaves."}
{"plan_idx": 320, "title": "vegetable-terrine", "question_idx": 320, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 13 happen after Step 4?", "why_question": "Why must Step 13 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 13 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, Step 13 does not have to happen after Step 4 because the vegetable preparation and the cream mixture preparation are two separate processes that can be carried out independently."}
{"plan_idx": 321, "title": "tortellini-fritto-with-almond-butter", "question_idx": 321, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not depend on Step 2, as it is a separate step involving serving and presentation of the dish."}
{"plan_idx": 322, "title": "spiced butternut squash soup", "question_idx": 322, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 13 happen after Step 4?", "why_question": "Why must Step 13 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 13 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not depend on step 4, and can be done after any prior step in the procedure."}
{"plan_idx": 323, "title": "white bread", "question_idx": 323, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 (placing dough in an oiled bowl and coating the dough) must happen after Step 4 (mixing flour into the yeast mixture) to prevent the dough from sticking to the bowl and to help it rise properly."}
{"plan_idx": 324, "title": "spiced-pumpkin-teabread", "question_idx": 324, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 must happen after Step 4 because Step 5 involves adding the honey and sultanas to the mashed pumpkin, which is only available after the pumpkin flesh has been steamed or cooked in Step 4."}
{"plan_idx": 325, "title": "spiced-pumpkin-teabread", "question_idx": 325, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (sprinkling pumpkin seeds) can happen before Step 8 (adding pumpkin mixture) as it does not depend on the pumpkin mixture being added."}
{"plan_idx": 326, "title": "chicken-prawn-and-rice-soup", "question_idx": 326, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 should happen after Step 9."}
{"plan_idx": 327, "title": "white bread", "question_idx": 327, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 12 happen after Step 4?", "why_question": "Why must Step 12 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 12 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: The procedure does not specify that Step 12 must happen after Step 4, and the order of these steps does not affect the outcome of the recipe."}
{"plan_idx": 328, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 328, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 involves kneading the dough, which requires the dough to have formed in Step 4."}
{"plan_idx": 329, "title": "spiced-pumpkin-teabread", "question_idx": 329, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why must Step 12 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 12 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not depend on Step 5 and can happen after any step in the procedure."}
{"plan_idx": 330, "title": "fusilli-and-meatballs", "question_idx": 330, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 19], "binary_question": "Must Step 20 happen after Step 7?", "why_question": "Why must Step 20 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 20 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 20 does not have to happen after Step 7 as there are other steps in between."}
{"plan_idx": 331, "title": "cranachan", "question_idx": 331, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 must happen after Step 4 because the instructions say to \"set aside to cool\" in Step 4, which implies that the oats should be left in the tray to cool."}
{"plan_idx": 332, "title": "chocolate-chocolate-cake", "question_idx": 332, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [14, 20], "binary_question": "Must Step 21 happen after Step 15?", "why_question": "Why must Step 21 happen after Step 15?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 15?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 21 (remove from tin and allow to cool) can happen after Step 20 (cool in the tin for 10 minutes)."}
{"plan_idx": 333, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 333, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: The cheese mixture in Step 2 does not need to be brushed with olive oil in Step 6."}
{"plan_idx": 334, "title": "spiced butternut squash soup", "question_idx": 334, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 13], "binary_question": "Must Step 14 happen after Step 11?", "why_question": "Why must Step 14 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 14 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14, returning the soup to the pot, must happen after step 13, blending the soup."}
{"plan_idx": 335, "title": "balsamic-and-mozzarella-chicken", "question_idx": 335, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not have to happen after Step 1, as the steps are not in chronological order."}
{"plan_idx": 336, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 336, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not depend on the outcome of Step 2, and can be performed at any time after Step 9."}
{"plan_idx": 337, "title": "brown sugar shortbread", "question_idx": 337, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Baking the shortbread should happen after rolling it and cutting it into strips, not after creaming the butter and sugar."}
{"plan_idx": 338, "title": "fusilli-and-meatballs", "question_idx": 338, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 9 must happen after Step 6 because the tomatoes need to be added to the saucepan before they can be brought to a boil."}
{"plan_idx": 339, "title": "strawberry-tiramisu-trifle", "question_idx": 339, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The sponge fingers must be soaked with coffee before they can be used to line the bowl in Step 6."}
{"plan_idx": 340, "title": "chicken and vegetable pie", "question_idx": 340, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [13, 15], "binary_question": "Must Step 16 happen after Step 14?", "why_question": "Why must Step 16 happen after Step 14?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 16 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 16 (cooling the pie for 10 minutes before serving) must happen after Step 14 (making several small slits in the top to allow steam to escape) to prevent the steam from escaping too quickly and making the pie soggy."}
{"plan_idx": 341, "title": "very-vanilla-ry-cheesecake", "question_idx": 341, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 12], "binary_question": "Must Step 13 happen after Step 12?", "why_question": "Why must Step 13 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 13 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 - refrigerating the cheesecake - must happen after Step 12 - cooling down the cheesecake in the oven - because the cheesecake needs to cool down before it can be refrigerated."}
{"plan_idx": 342, "title": "one-pot irish stew", "question_idx": 342, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Steps 7 and 8 involve garnishing and serving the stew, which should be done after seasoning it with salt and pepper in Step 6."}
{"plan_idx": 343, "title": "creamy-chayote-squash-soup", "question_idx": 343, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 must happen after Step 5 because the stock must be added to the mixture before it can be simmered."}
{"plan_idx": 344, "title": "lightly spiced tomato and red lentil soup", "question_idx": 344, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Yes, because step 11 instructs to \"Season to taste\", it requires the soup to be completed, which is done in step 6."}
{"plan_idx": 345, "title": "very-vanilla-ry-cheesecake", "question_idx": 345, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 13 happen after Step 9?", "why_question": "Why must Step 13 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 13 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 involves refrigerating the cheesecake, which should happen after the cheesecake has been baked (Step 9)."}
{"plan_idx": 346, "title": "vegetable-terrine", "question_idx": 346, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 14], "binary_question": "Must Step 15 happen after Step 8?", "why_question": "Why must Step 15 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 15 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 (serving the terrine) can be done after Step 14 (unmolding the terrine)."}
{"plan_idx": 347, "title": "chicken-prawn-and-rice-soup", "question_idx": 347, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 (Bring to the boil) should happen after Step 5 (Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans)."}
{"plan_idx": 348, "title": "easy strawberry tart", "question_idx": 348, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 2 (boiling) must happen after Step 1 (mixing the ingredients together) because the ingredients need to be mixed before they can be boiled."}
{"plan_idx": 349, "title": "spiced-pumpkin-teabread", "question_idx": 349, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why must Step 11 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 11 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (baking the loaf) should happen after Step 10 (sprinkling with pumpkin seeds) and not after Step 7 (rubbing in the butter)."}
{"plan_idx": 350, "title": "curried bbq mussels", "question_idx": 350, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 must happen after Step 1 because Step 10 instructs the user to discard any mussels that do not open, and this can only be determined after the mussels have been cooked in the foil packets."}
{"plan_idx": 351, "title": "spiced butternut squash soup", "question_idx": 351, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 14], "binary_question": "Must Step 15 happen after Step 13?", "why_question": "Why must Step 15 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 15 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 15 must happen after Step 13 because the soup needs to be pureed to a smooth consistency before adding the seasonings."}
{"plan_idx": 352, "title": "chocolate-pancake-batter", "question_idx": 352, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 must happen after Step 5 because you must heat the pan before greasing it."}
{"plan_idx": 353, "title": "spiced-pumpkin-teabread", "question_idx": 353, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why must Step 13 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 13 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 (brushing with honey) should happen after Step 12 (cooling the loaf on a wire rack), not after Step 1."}
{"plan_idx": 354, "title": "white bread", "question_idx": 354, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 can happen after Step 8 as the dough needs to rise first."}
{"plan_idx": 355, "title": "simple-basic-cupcakes", "question_idx": 355, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: It is not necessary for Step 9 to happen after Step 2 because Step 9 involves letting the cupcakes rest and cool, which is unrelated to Step 2 of beating the butter and sugar together."}
{"plan_idx": 356, "title": "chicken-prawn-and-rice-soup", "question_idx": 356, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 should happen after Step 5, because you need to add all the ingredients to the pot before bringing it to a boil."}
{"plan_idx": 357, "title": "frugal-beef-stew", "question_idx": 357, "steps": ["Add the onion and beef to a frying pan with a little oil (if you feel it requires it, depends on how good your pan is) and cook until the onions are soft.", "Tip out the onion/beef into a casserole dish and add the rest of the ingredients to the frying pan with half the stock, cooking on a high heat for about 10 minutes.", "Pour the contents of the frying pan into the casserole dish along with the thyme and rest of the stock (and a little bit of pepper if you like) and put on the lid.", "Cook in the oven on a low heat (about 140 C) for around 3-4 hours, giving it a stir every hour."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: frugal-beef-stew\n\nProcedure:\n1. Add the onion and beef to a frying pan with a little oil (if you feel it requires it, depends on how good your pan is) and cook until the onions are soft.\n2. Tip out the onion/beef into a casserole dish and add the rest of the ingredients to the frying pan with half the stock, cooking on a high heat for about 10 minutes.\n3. Pour the contents of the frying pan into the casserole dish along with the thyme and rest of the stock (and a little bit of pepper if you like) and put on the lid.\n4. Cook in the oven on a low heat (about 140 C) for around 3-4 hours, giving it a stir every hour.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 involves cooking the stew in the oven, which requires the ingredients to be combined in the casserole dish from Step 3."}
{"plan_idx": 358, "title": "banana-split-cake", "question_idx": 358, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not depend on Step 4, as it only requires the bananas to be sliced and the strawberries to be layered over them."}
{"plan_idx": 359, "title": "apple-pumpkin-spread", "question_idx": 359, "steps": ["In a medium saucepan over medium heat, mix pumpkin puree, apple sauce, apple juice, dark brown soft sugar and spices.", "Bring mixture to the boil.", "Reduce heat and simmer approximately 1 1/2 hours.", "Transfer to sterile containers and chill in the refrigerator until serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: apple-pumpkin-spread\n\nProcedure:\n1. In a medium saucepan over medium heat, mix pumpkin puree, apple sauce, apple juice, dark brown soft sugar and spices.\n2. Bring mixture to the boil.\n3. Reduce heat and simmer approximately 1 1/2 hours.\n4. Transfer to sterile containers and chill in the refrigerator until serving.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 requires the spread to be transferred to sterile containers and chilled in the refrigerator, which can only be done after the mixture has been simmered in Step 3."}
{"plan_idx": 360, "title": "chicken and vegetable pie", "question_idx": 360, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 15], "binary_question": "Must Step 16 happen after Step 12?", "why_question": "Why must Step 16 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 16 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 16 (Cooling the pie for 10 minutes before serving) must happen after Step 12 (Pouring the hot liquid mixture over the chicken mixture) to prevent the hot filling from burning the pastry and to allow the pie to set properly."}
{"plan_idx": 361, "title": "chicken and vegetable pie", "question_idx": 361, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 15], "binary_question": "Must Step 16 happen after Step 6?", "why_question": "Why must Step 16 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 16 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16 does not depend on Step 6, as it involves cooling the pie before serving, which can be done after any step."}
{"plan_idx": 362, "title": "spiced butternut squash soup", "question_idx": 362, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 14 happen after Step 4?", "why_question": "Why must Step 14 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 14 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14, returning the pureed soup to the pot, can happen at any time after the soup has been pureed in Step 13 and does not have to happen after Step 4."}
{"plan_idx": 363, "title": "chocolate-pancake-batter", "question_idx": 363, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not need to happen after Step 2 because there are other steps in between that must be completed first."}
{"plan_idx": 364, "title": "old-fashioned-welsh-rarebit", "question_idx": 364, "steps": ["Grate 250g well-flavoured mature Cheddar cheese (you can also use a good Double Gloucester or Shropshire) and put into a heavy-based medium-sized pan (preferably nonstick) with 10g butter, 1 tsp mustard (English, wholegrain or Dijon), plenty of ground black pepper and 4 tbsp ale or semi-skimmed milk.", "Set over a low heat and melt gently, stirring, until smooth and thick.", "Spoon onto 4 thick slices of toast and grill until browned and bubbling.", "Serve with grilled mushrooms and a leaf salad for a light lunch or snack."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: old-fashioned-welsh-rarebit\n\nProcedure:\n1. Grate 250g well-flavoured mature Cheddar cheese (you can also use a good Double Gloucester or Shropshire) and put into a heavy-based medium-sized pan (preferably nonstick) with 10g butter, 1 tsp mustard (English, wholegrain or Dijon), plenty of ground black pepper and 4 tbsp ale or semi-skimmed milk.\n2. Set over a low heat and melt gently, stirring, until smooth and thick.\n3. Spoon onto 4 thick slices of toast and grill until browned and bubbling.\n4. Serve with grilled mushrooms and a leaf salad for a light lunch or snack.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 2 must happen after Step 1 because the cheese sauce must be melted gently before it can be spooned onto the toast."}
{"plan_idx": 365, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 365, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 14], "binary_question": "Must Step 15 happen after Step 13?", "why_question": "Why must Step 15 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 15 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 15 depends on the whipped cream produced in Step 13."}
{"plan_idx": 366, "title": "almond and apple cake", "question_idx": 366, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 13 happen after Step 9?", "why_question": "Why must Step 13 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 13 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 (setting aside in the pan to cool) should happen after Step 12 (baking in the oven), not after Step 9."}
{"plan_idx": 367, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 367, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 (cooling shortcakes on wire rack for 15 minutes) must happen after Step 9 (baking shortcakes) to allow them to cool before assembling the shortcakes."}
{"plan_idx": 368, "title": "simple-basic-cupcakes", "question_idx": 368, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 (adding the flour) should happen after Step 4 (adjusting batter consistency with milk) because the flour can affect the consistency of the batter."}
{"plan_idx": 369, "title": "curried bbq mussels", "question_idx": 369, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 (wrapping foil tightly around the portions) must happen after Step 5 (dotting the mussels with the curry mixture) to avoid losing the curry mixture before the mussels are cooked."}
{"plan_idx": 370, "title": "spiced butternut squash soup", "question_idx": 370, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 requires the baking dish with water to be preheated in the oven, which is a condition created in Step 2."}
{"plan_idx": 371, "title": "vegetable-terrine", "question_idx": 371, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 13 happen after Step 6?", "why_question": "Why must Step 13 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 13 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 (refrigerating the terrine) should happen after Step 12 (pouring the remaining cream mixture on top)."}
{"plan_idx": 372, "title": "chocolate-chocolate-cake", "question_idx": 372, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 16], "binary_question": "Must Step 17 happen after Step 6?", "why_question": "Why must Step 17 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 17 (bake for 1 hour) must happen after Step 16 (pour the mixture into the cake tin), not after Step 6 (beat butter and margarine together in a large bowl until creamy)."}
{"plan_idx": 373, "title": "vegetable-terrine", "question_idx": 373, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 13], "binary_question": "Must Step 14 happen after Step 12?", "why_question": "Why must Step 14 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 14 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The terrine needs to be refrigerated and set before it can be removed from the mould in Step 14."}
{"plan_idx": 374, "title": "chicken-prawn-and-rice-soup", "question_idx": 374, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 12], "binary_question": "Must Step 13 happen after Step 7?", "why_question": "Why must Step 13 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 13 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 involves adding salt and sherry, while Step 13 involves serving and enjoying the soup, which can be done after Step 9 when the soup is finished simmering."}
{"plan_idx": 375, "title": "spiced butternut squash soup", "question_idx": 375, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 15], "binary_question": "Must Step 16 happen after Step 13?", "why_question": "Why must Step 16 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 16 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 involves pureeing the soup, while Step 16 requires the soup to be in a pot to be seasoned and heated."}
{"plan_idx": 376, "title": "curried bbq mussels", "question_idx": 376, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not depend on Step 6, as it instructs to discard unopened mussels regardless of the order in which they were topped with red pepper and parsley."}
{"plan_idx": 377, "title": "chocolate-chocolate-cake", "question_idx": 377, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 20], "binary_question": "Must Step 21 happen after Step 6?", "why_question": "Why must Step 21 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 21 must happen after Step 20 because the cake must cool slightly before it can be removed from the tin."}
{"plan_idx": 378, "title": "busters-liver-dinner", "question_idx": 378, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 3 is optional and can be done at any time during the cooking process if the mixture starts to look too dry."}
{"plan_idx": 379, "title": "green-tofu-curry", "question_idx": 379, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 12 happen after Step 8?", "why_question": "Why must Step 12 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 12 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not depend on Step 8, as it only requires the rice and curry to be ready."}
{"plan_idx": 380, "title": "slow cooker butter chicken", "question_idx": 380, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not depend on Step 1, as it involves cooking the dish in a slow cooker."}
{"plan_idx": 381, "title": "chicken and vegetable pie", "question_idx": 381, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 12 happen after Step 4?", "why_question": "Why must Step 12 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 12 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 (pouring the hot liquid mixture over the chicken mixture) must happen after Step 4 (draining the chicken and vegetables) because the vegetables need to be cooked before the liquid can be added."}
{"plan_idx": 382, "title": "fusilli-and-meatballs", "question_idx": 382, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 17], "binary_question": "Must Step 18 happen after Step 5?", "why_question": "Why must Step 18 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 18 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 18 involves cooking the meatballs in the tomato sauce, which requires the meatballs to be already made, so it cannot happen after Step 5, which is before the meatballs are made."}
{"plan_idx": 383, "title": "chocolate-chocolate-cake", "question_idx": 383, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 17], "binary_question": "Must Step 18 happen after Step 12?", "why_question": "Why must Step 18 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 18 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 18 (checking if the cake is ready by inserting a skewer) must happen after Step 12 (beating egg white mixture into the chocolate mixture) because the cake needs to be baked before it can be tested for doneness."}
{"plan_idx": 384, "title": "easy-coconut-rice", "question_idx": 384, "steps": ["Combine rice with the coconut milk, water, salt, sugar and cinnamon stick in a large saucepan with a tight-fitting lid.", "Bring to the boil; reduce the heat to a simmer and cover.", "Cook until the liquid is absorbed and the rice is tender, about 25 minutes.", "Remove cinnamon stick to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy-coconut-rice\n\nProcedure:\n1. Combine rice with the coconut milk, water, salt, sugar and cinnamon stick in a large saucepan with a tight-fitting lid.\n2. Bring to the boil; reduce the heat to a simmer and cover.\n3. Cook until the liquid is absorbed and the rice is tender, about 25 minutes.\n4. Remove cinnamon stick to serve.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, Step 4 does not have to happen after Step 2 because it is the final step in the procedure."}
{"plan_idx": 385, "title": "spiced butternut squash soup", "question_idx": 385, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 15], "binary_question": "Must Step 16 happen after Step 7?", "why_question": "Why must Step 16 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 16 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 (melt the butter) does not need to happen before Step 16 (season the soup)."}
{"plan_idx": 386, "title": "almost no fat banana bread", "question_idx": 386, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not depend on step 5."}
{"plan_idx": 387, "title": "almond and apple cake", "question_idx": 387, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 must happen after Step 4 because the ground almonds are added to the butter, caster sugar and vanilla mixture after it has been beaten for 8 minutes or until pale and creamy."}
{"plan_idx": 388, "title": "green-tofu-curry", "question_idx": 388, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 involves mixing in green curry paste to the coconut milk, which must be brought to a boil in Step 9."}
{"plan_idx": 389, "title": "spiced-pumpkin-teabread", "question_idx": 389, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 12], "binary_question": "Must Step 13 happen after Step 2?", "why_question": "Why must Step 13 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 13 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not depend on Step 2, as it instructs to brush the loaf with honey after baking, which can be done after the loaf has been removed from the tin and cooled."}
{"plan_idx": 390, "title": "almond and apple cake", "question_idx": 390, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 does not have to happen after Step 5 because other steps 6 to 10 need to be completed first."}
{"plan_idx": 391, "title": "curried bbq mussels", "question_idx": 391, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 involves wrapping foil tightly around the portions, which must be done after the mussels have been divided and placed on the foil in Step 4."}
{"plan_idx": 392, "title": "almost no fat banana bread", "question_idx": 392, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 must happen after Step 6 because the banana bread needs to cool before it can be sliced."}
{"plan_idx": 393, "title": "balsamic-and-mozzarella-chicken", "question_idx": 393, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 (serving) can only be done after Step 8 (covering the chicken with tomato slices) is completed."}
{"plan_idx": 394, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 394, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 (letting the rolls cool) can happen after any step, as long as the rolls have been grilled first (Step 8)."}
{"plan_idx": 395, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 395, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 8 involves mixing in the sliced roasted red peppers, which are not introduced until Step 7."}
{"plan_idx": 396, "title": "simple-basic-cupcakes", "question_idx": 396, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not rely on the results of Step 3 and can be done independently of it."}
{"plan_idx": 397, "title": "spiced-pumpkin-teabread", "question_idx": 397, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 12], "binary_question": "Must Step 13 happen after Step 3?", "why_question": "Why must Step 13 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 13 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not depend on Step 3 and can be done after any step."}
{"plan_idx": 398, "title": "spicy-tomato-anchovy-pasta", "question_idx": 398, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 requires the vegetables to be lightly browned, which occurs in Step 2."}
{"plan_idx": 399, "title": "vegetable-terrine", "question_idx": 399, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 12], "binary_question": "Must Step 13 happen after Step 5?", "why_question": "Why must Step 13 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 13 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not depend on the completion of step 5."}
{"plan_idx": 400, "title": "brown sugar shortbread", "question_idx": 400, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The shortbread must be placed on ungreased baking trays before baking in the preheated oven."}
{"plan_idx": 401, "title": "jam-drop-biscuits", "question_idx": 401, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not need to happen after Step 2 because chilling the dough (Step 3) is necessary for the biscuits to firm up and be able to be formed into balls and rolled in ground hazelnuts."}
{"plan_idx": 402, "title": "fusilli-and-meatballs", "question_idx": 402, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 19], "binary_question": "Must Step 20 happen after Step 12?", "why_question": "Why must Step 20 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 20 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 20 involves tossing the cooked pasta with sauce, which is not possible before Step 12 produces the sauce."}
{"plan_idx": 403, "title": "vegetable-terrine", "question_idx": 403, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not require the completion of Step 5."}
{"plan_idx": 404, "title": "no-sugar-rock-cakes", "question_idx": 404, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 must happen after Step 5 because the dough needs to be mixed into a dough before it can be placed onto the baking tray."}
{"plan_idx": 405, "title": "chocolate-chocolate-cake", "question_idx": 405, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 21], "binary_question": "Must Step 22 happen after Step 3?", "why_question": "Why must Step 22 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 22 (sifting icing sugar over the cake) can be done any time after the cake has cooled completely."}
{"plan_idx": 406, "title": "creamy-chayote-squash-soup", "question_idx": 406, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not depend on Step 1 and can happen after any of the other steps."}
{"plan_idx": 407, "title": "banana-split-cake", "question_idx": 407, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why must Step 11 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 11 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 does not have to happen after Step 4 because Steps 5, 6, 7, 8, 9 and 10 can be done in between."}
{"plan_idx": 408, "title": "vegetable-terrine", "question_idx": 408, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 13 happen after Step 9?", "why_question": "Why must Step 13 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 13 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 should happen after Step 9 as it instructs to let the cream mixture cool for a few minutes before proceeding."}
{"plan_idx": 409, "title": "banana-split-cake", "question_idx": 409, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 (cooling the base) must be done before adding the fruit toppings (Steps 9 and 10), as the hot base could melt the fruit."}
{"plan_idx": 410, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 410, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 14], "binary_question": "Must Step 15 happen after Step 6?", "why_question": "Why must Step 15 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 15 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 15 involves assembling the shortcakes and requires the strawberries and whipped cream prepared in Step 6."}
{"plan_idx": 411, "title": "almost no fat banana bread", "question_idx": 411, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2:  Step 7, which advises waiting until the loaf has cooled before slicing it does not have to happen after Step 2, which involves lightly greasing a loaf tin."}
{"plan_idx": 412, "title": "spiced butternut squash soup", "question_idx": 412, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 16], "binary_question": "Must Step 17 happen after Step 4?", "why_question": "Why must Step 17 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 17 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: No\nAnswer 2: Step 17 does not depend on the completion of Step 4."}
{"plan_idx": 413, "title": "white bread", "question_idx": 413, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not depend on Step 4 and can happen after any of the previous steps."}
{"plan_idx": 414, "title": "chicken-prawn-and-rice-soup", "question_idx": 414, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 4 does not depend on the completion of Step 1."}
{"plan_idx": 415, "title": "no-sugar-rock-cakes", "question_idx": 415, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The rock cakes need to be placed on a cooling tray after baking to prevent them from overcooking."}
{"plan_idx": 416, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 416, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 15], "binary_question": "Must Step 16 happen after Step 9?", "why_question": "Why must Step 16 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 16 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16 (assembling the shortcakes) can happen after Step 9 (baking the shortcakes) because the shortcakes need to cool for 15 minutes before they can be assembled."}
{"plan_idx": 417, "title": "lightly spiced tomato and red lentil soup", "question_idx": 417, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 11], "binary_question": "Must Step 12 happen after Step 6?", "why_question": "Why must Step 12 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 12 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 is serving the soup, so it must happen after the last step of preparation, which is Step 11."}
{"plan_idx": 418, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 418, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [13, 14], "binary_question": "Must Step 15 happen after Step 14?", "why_question": "Why must Step 15 happen after Step 14?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 15 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The shortcakes need to be split in half before they can be assembled."}
{"plan_idx": 419, "title": "black-rice-pudding", "question_idx": 419, "steps": ["Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.", "Bring to the boil over high heat, stirring frequently.", "Reduce heat to medium-low.", "Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.", "Stir in coconut cream and vanilla extract.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: black-rice-pudding\n\nProcedure:\n1. Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.\n2. Bring to the boil over high heat, stirring frequently.\n3. Reduce heat to medium-low.\n4. Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.\n5. Stir in coconut cream and vanilla extract.\n6. Serve warm.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 (reduce heat to medium-low) must happen after Step 1 (combine rice, sugar, and water in a saucepan) because the water needs to be brought to a boil first (Step 2)."}
{"plan_idx": 420, "title": "balsamic-and-mozzarella-chicken", "question_idx": 420, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not have to happen after Step 2, as the mozzarella is added to the chicken after it has been cooked."}
{"plan_idx": 421, "title": "chocolate-pancake-batter", "question_idx": 421, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 cannot happen after Step 2 because Step 9 involves flipping the pancake and Step 2 involves whisking in the beaten eggs."}
{"plan_idx": 422, "title": "fusilli-and-meatballs", "question_idx": 422, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 20], "binary_question": "Must Step 21 happen after Step 2?", "why_question": "Why must Step 21 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 21 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 21 (spooning the meatballs and remaining sauce over the pasta) should happen after Step 20 (tossing the pasta with the sauce)."}
{"plan_idx": 423, "title": "chocolate-chocolate-cake", "question_idx": 423, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 17], "binary_question": "Must Step 18 happen after Step 10?", "why_question": "Why must Step 18 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 18 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 involves adding the cooled chocolate to the mix, while Step 18 is about checking if the cake is ready by inserting a skewer, so it is not necessary for Step 18 to happen after Step 10."}
{"plan_idx": 424, "title": "spicy-tomato-anchovy-pasta", "question_idx": 424, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 (stir in spring onions, tomatoes and parsley) must happen after Step 3 (simmer for 4 to 5 minutes) because the spring onions, tomatoes, and parsley are not added to the pan until after the anchovies have cooked."}
{"plan_idx": 425, "title": "brown sugar shortbread", "question_idx": 425, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Cutting the dough into strips can be done after any of the mixing steps."}
{"plan_idx": 426, "title": "brown sugar shortbread", "question_idx": 426, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 (kneading) is done to develop the gluten in the dough, which is essential for the shortbread to have the correct texture. This step cannot be done before the flour is added in Step 3."}
{"plan_idx": 427, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 427, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 2, 3 and 4 should happen before Step 5."}
{"plan_idx": 428, "title": "lightly spiced tomato and red lentil soup", "question_idx": 428, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 must happen after Step 5 because it involves adding lentils, stock, and other ingredients to the pot."}
{"plan_idx": 429, "title": "creamy-chayote-squash-soup", "question_idx": 429, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not have to happen after Step 6 because Step 7 (simmering for 20 minutes) must be completed before Step 8 (pouring the mixture into a liquidiser)."}
{"plan_idx": 430, "title": "chocolate-pancake-batter", "question_idx": 430, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why must Step 11 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 11 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (stacking pancakes to keep warm) does not need to happen immediately after step 7 (pouring batter into the pan)."}
{"plan_idx": 431, "title": "one-pot irish stew", "question_idx": 431, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not depend on the outcome of Step 3, it can be performed at any time after Step 6."}
{"plan_idx": 432, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 432, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not depend on Step 4, as it involves baking the shortcakes, which can only happen after the dough has been formed."}
{"plan_idx": 433, "title": "chocolate-pancake-batter", "question_idx": 433, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: It is necessary to whisk in the milk, melted butter and sugar (Step 3) before proceeding to pour the batter into the pan."}
{"plan_idx": 434, "title": "white bread", "question_idx": 434, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 11], "binary_question": "Must Step 12 happen after Step 10?", "why_question": "Why must Step 12 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 12 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 must happen after Step 10 because Step 10 requires the dough to be divided in half and shaped into loaves, which is necessary before the dough can be placed into the loaf tins and allowed to rise."}
{"plan_idx": 435, "title": "spiced butternut squash soup", "question_idx": 435, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [13, 16], "binary_question": "Must Step 17 happen after Step 14?", "why_question": "Why must Step 17 happen after Step 14?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 17 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Heating the soup through (Step 16) is done before ladling into bowls (Step 17)."}
{"plan_idx": 436, "title": "chicken-prawn-and-rice-soup", "question_idx": 436, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 (reduce heat and allow to simmer) does not depend on Step 1 (mix together the prawns, chicken, egg and cornflour)."}
{"plan_idx": 437, "title": "curried bbq mussels", "question_idx": 437, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not depend on Step 2, as both steps involve separate tasks that can be completed independently."}
{"plan_idx": 438, "title": "very-vanilla-ry-cheesecake", "question_idx": 438, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: Yes\nAnswer 2: The cheesecake mixture must be poured into the biscuit base after it has been blended and smoothed in Step 8."}
{"plan_idx": 439, "title": "very-vanilla-ry-cheesecake", "question_idx": 439, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: \nStep 9 does not depend on Step 6 being completed first, as the biscuit base is created separately from the cheesecake filling."}
{"plan_idx": 440, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 440, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 1, 2, 3, 4, 5, 6, 7, and 8 must be completed before Step 9."}
{"plan_idx": 441, "title": "balsamic-and-mozzarella-chicken", "question_idx": 441, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 (Serve!) must happen after Step 9 (Drizzle balsamic vinegar over the platter, then season with salt and pepper) because you need to finish seasoning the dish before serving it."}
{"plan_idx": 442, "title": "one-pot irish stew", "question_idx": 442, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not have to happen after Step 2 because the procedure does not specify that it must."}
{"plan_idx": 443, "title": "chocolate-chocolate-cake", "question_idx": 443, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 16], "binary_question": "Must Step 17 happen after Step 8?", "why_question": "Why must Step 17 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 17 does not depend on Step 8, as it involves baking the cake after the batter is prepared."}
{"plan_idx": 444, "title": "apple-pumpkin-spread", "question_idx": 444, "steps": ["In a medium saucepan over medium heat, mix pumpkin puree, apple sauce, apple juice, dark brown soft sugar and spices.", "Bring mixture to the boil.", "Reduce heat and simmer approximately 1 1/2 hours.", "Transfer to sterile containers and chill in the refrigerator until serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: apple-pumpkin-spread\n\nProcedure:\n1. In a medium saucepan over medium heat, mix pumpkin puree, apple sauce, apple juice, dark brown soft sugar and spices.\n2. Bring mixture to the boil.\n3. Reduce heat and simmer approximately 1 1/2 hours.\n4. Transfer to sterile containers and chill in the refrigerator until serving.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 4 does not have to happen after Step 2 because Step 3 occurs after Step 2."}
{"plan_idx": 445, "title": "no-sugar-rock-cakes", "question_idx": 445, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 (baking) must happen after Step 6 (placing the dough balls on the baking tray) because the dough needs to be placed in the oven to bake."}
{"plan_idx": 446, "title": "chicken and vegetable pie", "question_idx": 446, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 13], "binary_question": "Must Step 14 happen after Step 13?", "why_question": "Why must Step 14 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 14 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 14 (slitting the top pastry) must happen after Step 13 (covering the pie with top pastry) to allow steam to escape during baking."}
{"plan_idx": 447, "title": "almond and apple cake", "question_idx": 447, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Ground almonds should be added after the eggs have been incorporated into the mixture for a smooth and even batter."}
{"plan_idx": 448, "title": "fusilli-and-meatballs", "question_idx": 448, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why must Step 13 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 can happen after Step 4 because Step 3 is to transfer 2 tablespoons of the onion mixture to a large bowl and Step 4 is to set it aside."}
{"plan_idx": 449, "title": "chocolate-chocolate-cake", "question_idx": 449, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 13 happen after Step 8?", "why_question": "Why must Step 13 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 13 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 must happen after Step 8 because Step 8 instructs to gradually beat in egg yolks one at a time, whereas Step 13 instructs to fold in the egg white mixture. "}
{"plan_idx": 450, "title": "tortellini-fritto-with-almond-butter", "question_idx": 450, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not depend on Step 1 and can be performed at any time after Step 3."}
{"plan_idx": 451, "title": "chocolate-pancake-batter", "question_idx": 451, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not depend on Step 4, it depends on Step 8."}
{"plan_idx": 452, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 452, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 15], "binary_question": "Must Step 16 happen after Step 1?", "why_question": "Why must Step 16 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 16 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16, assembling the shortcakes, cannot happen after Step 1 as it involves placing the shortcake bottoms on dessert plates, which requires the shortcakes to be already baked."}
{"plan_idx": 453, "title": "chocolate-chocolate-cake", "question_idx": 453, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 17], "binary_question": "Must Step 18 happen after Step 5?", "why_question": "Why must Step 18 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 18 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 18 involves checking if the cake is ready, which should happen after the cake has baked (Step 17)."}
{"plan_idx": 454, "title": "cranachan", "question_idx": 454, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 9], "binary_question": "Must Step 10 happen after Step 2?", "why_question": "Why must Step 10 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 10 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 is not dependent on Step 2, as it involves garnishing the finished dish."}
{"plan_idx": 455, "title": "chicken-prawn-and-rice-soup", "question_idx": 455, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 13 happen after Step 8?", "why_question": "Why must Step 13 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 13 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 (serving the soup) must happen after Step 8 (returning the soup to the boil) because the soup is not ready to be served until it has been boiled."}
{"plan_idx": 456, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 456, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [13, 15], "binary_question": "Must Step 16 happen after Step 14?", "why_question": "Why must Step 16 happen after Step 14?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 16 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 14 (split shortcakes in half) must be done before Step 16 (cover with shortcake top) to assemble the shortcakes correctly."}
{"plan_idx": 457, "title": "curried bbq mussels", "question_idx": 457, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (discarding any unopened mussels) can happen after any of the other steps, since it is not dependent on any specific previous step."}
{"plan_idx": 458, "title": "chocolate-chocolate-cake", "question_idx": 458, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 20], "binary_question": "Must Step 21 happen after Step 10?", "why_question": "Why must Step 21 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: No\nAnswer 2: Step 21 must happen after step 20 because the cake needs to cool in the tin for 10 minutes to set before it can be removed from the tin."}
{"plan_idx": 459, "title": "slow cooker butter chicken", "question_idx": 459, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5, pouring the mixture into the slow cooker, must occur after Step 3, cooking the onion until translucent, as the mixture needs the onion to be cooked before it can be poured into the slow cooker."}
{"plan_idx": 460, "title": "chicken and vegetable pie", "question_idx": 460, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 15], "binary_question": "Must Step 16 happen after Step 13?", "why_question": "Why must Step 16 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 16 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The pie needs to bake in the oven after the top pastry is added (step 13) before it can be cooled and served."}
{"plan_idx": 461, "title": "one-pot irish stew", "question_idx": 461, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 must happen after Step 5 because the vegetables must be cooked before they can be seasoned to taste."}
{"plan_idx": 462, "title": "black-rice-pudding", "question_idx": 462, "steps": ["Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.", "Bring to the boil over high heat, stirring frequently.", "Reduce heat to medium-low.", "Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.", "Stir in coconut cream and vanilla extract.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: black-rice-pudding\n\nProcedure:\n1. Rinse and drain glutinous black rice and glutinous white rice, then combine with sugar and water in a large saucepan.\n2. Bring to the boil over high heat, stirring frequently.\n3. Reduce heat to medium-low.\n4. Cover and cook until rice is tender and creamy, stirring occasionally, about 45 minutes.\n5. Stir in coconut cream and vanilla extract.\n6. Serve warm.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: The coconut cream and vanilla extract are not added until Step 5, which can be done after Step 2."}
{"plan_idx": 463, "title": "vegetable-terrine", "question_idx": 463, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 13], "binary_question": "Must Step 14 happen after Step 6?", "why_question": "Why must Step 14 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 14 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 is an optional step that can be skipped if a silicone mould is used in Step 10."}
{"plan_idx": 464, "title": "chocolate-chocolate-cake", "question_idx": 464, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 16], "binary_question": "Must Step 17 happen after Step 4?", "why_question": "Why must Step 17 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 4 is microwave and whisk the chocolate mixture until smooth, not bake the cake."}
{"plan_idx": 465, "title": "spiced-pumpkin-teabread", "question_idx": 465, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 13 happen after Step 6?", "why_question": "Why must Step 13 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 13 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 should happen after Step 12 because it instructs you to brush the loaf with honey while it's still warm."}
{"plan_idx": 466, "title": "fusilli-and-meatballs", "question_idx": 466, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 17], "binary_question": "Must Step 18 happen after Step 3?", "why_question": "Why must Step 18 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 18 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 3 has the reader set aside a small amount of the onion mixture and step 18 is to cover and cook the meatballs in the tomato sauce for 20 minutes. There is no logical reason for step 18 to happen after step 3."}
{"plan_idx": 467, "title": "fusilli-and-meatballs", "question_idx": 467, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 11], "binary_question": "Must Step 12 happen after Step 1?", "why_question": "Why must Step 12 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 12 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 involves adding ingredients to the onion mixture, which is not available until after Step 1."}
{"plan_idx": 468, "title": "chocolate-chocolate-cake", "question_idx": 468, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 16], "binary_question": "Must Step 17 happen after Step 10?", "why_question": "Why must Step 17 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Baking for 1 hour (Step 17) must be done after the egg white mixture is folded into the chocolate mixture (Step 10)."}
{"plan_idx": 469, "title": "fusilli-and-meatballs", "question_idx": 469, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 16], "binary_question": "Must Step 17 happen after Step 7?", "why_question": "Why must Step 17 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 17 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The meatballs are added to the tomato sauce in Step 17, and the sauce must be sufficiently cooked in Step 7 before the meatballs can be added to cook."}
{"plan_idx": 470, "title": "spiced-pumpkin-teabread", "question_idx": 470, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (baking the loaf) must happen after Step 10 (sprinkling the loaf with pumpkin seeds) because the loaf needs to be prepared for baking before it can be baked."}
{"plan_idx": 471, "title": "spiced-pumpkin-teabread", "question_idx": 471, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 9 (tipping the mixture into the prepared tin) must happen after Step 8 (beating the pumpkin mixture with the sifted flour) so that the combined ingredients can be properly poured and smoothed in the tin."}
{"plan_idx": 472, "title": "chocolate-chocolate-cake", "question_idx": 472, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 13 happen after Step 4?", "why_question": "Why must Step 13 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 13 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The cooled chocolate must be added to the mixture in step 10, before the egg whites are added in step 13."}
{"plan_idx": 473, "title": "very-vanilla-ry-cheesecake", "question_idx": 473, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not need to happen after Step 7 as it can happen after Step 8, which incorporates the seeds of 2 vanilla beans, vanilla extract, soured cream, and double cream."}
{"plan_idx": 474, "title": "chocolate-chocolate-cake", "question_idx": 474, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 16], "binary_question": "Must Step 17 happen after Step 5?", "why_question": "Why must Step 17 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 17 refers to baking the cake, which is done after all the ingredients have been mixed and the batter has been poured into the cake tin, which is done in steps 1-16. Step 5 refers to setting aside the chocolate mixture to cool, which can be done before or after step 17."}
{"plan_idx": 475, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 475, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 should happen after Step 5, as it instructs to add a variety of ingredients and cook until the mushrooms are coated with sauce."}
{"plan_idx": 476, "title": "creamy-chayote-squash-soup", "question_idx": 476, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The procedure states that the butter must be melted before adding the onion, garlic, and crushed chillies."}
{"plan_idx": 477, "title": "banana-split-cake", "question_idx": 477, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not depend on Step 7, as the banana slices are arranged on the filling after the frosting is spread."}
{"plan_idx": 478, "title": "best-ever-margarita", "question_idx": 478, "steps": ["Rim 2 margarita glasses with salt if desired and fill with ice.", "Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.", "Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.", "Pour into prepared margarita glasses and serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: best-ever-margarita\n\nProcedure:\n1. Rim 2 margarita glasses with salt if desired and fill with ice.\n2. Pour the tequila, lime cordial, triple sec and lemon-lime soft drink into a cocktail shaker filled with ice.\n3. Hold your hand firmly over over the top of the shaker so the top doesn't pop off from the fizzy soft drink and shake vigorously.\n4. Pour into prepared margarita glasses and serve.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 2 requires shaking the cocktail, which must happen before pouring the drink into the glasses in Step 4."}
{"plan_idx": 479, "title": "tomato and basil salad", "question_idx": 479, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not need to happen immediately after Step 3, it can be done after Step 4 as well."}
{"plan_idx": 480, "title": "chocolate-chocolate-cake", "question_idx": 480, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 16], "binary_question": "Must Step 17 happen after Step 7?", "why_question": "Why must Step 17 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 17 involves baking the cake, which should happen after the cake batter is prepared in Steps 6-16."}
{"plan_idx": 481, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 481, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 (mix the lentils and tomatoes) must happen after Step 4 (drain the tomatoes) because the tomatoes need to be drained before they can be mixed with the lentils."}
{"plan_idx": 482, "title": "spiced butternut squash soup", "question_idx": 482, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 15], "binary_question": "Must Step 16 happen after Step 12?", "why_question": "Why must Step 16 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 16 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16 does not depend on Step 12 and can be performed independently."}
{"plan_idx": 483, "title": "banana-split-cake", "question_idx": 483, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 involves spreading a mixture over a cooled base, which requires the base to be baked and cooled first."}
{"plan_idx": 484, "title": "spiced butternut squash soup", "question_idx": 484, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 13], "binary_question": "Must Step 14 happen after Step 8?", "why_question": "Why must Step 14 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 14 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 (returning the soup to the pot) should happen after Step 13 (pureeing the soup)."}
{"plan_idx": 485, "title": "spiced butternut squash soup", "question_idx": 485, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 12 happen after Step 3?", "why_question": "Why must Step 12 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 12 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 (mashing the squash and potatoes) requires the squash to be peeled (Step 5), which in turn requires the squash to be cooled slightly (Step 4), which requires the squash to be baked (Step 3)."}
{"plan_idx": 486, "title": "spiced-pumpkin-teabread", "question_idx": 486, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 12 happen after Step 3?", "why_question": "Why must Step 12 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 12 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 involves cooling the loaf after baking, which is not dependent on Step 3 which involves steaming the pumpkin flesh."}
{"plan_idx": 487, "title": "fusilli-and-meatballs", "question_idx": 487, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, Step 8 can happen before Step 5 because the steps are not sequential."}
{"plan_idx": 488, "title": "spiced butternut squash soup", "question_idx": 488, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 14], "binary_question": "Must Step 15 happen after Step 1?", "why_question": "Why must Step 15 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 15 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 does not require the completion of Step 1 and can be done after other steps in the procedure."}
{"plan_idx": 489, "title": "white bread", "question_idx": 489, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 (allowing the dough to rise) must happen after Step 7 (covering the dough with a damp cloth) to create a warm and humid environment for the yeast to activate and make the dough rise."}
{"plan_idx": 490, "title": "lightly spiced tomato and red lentil soup", "question_idx": 490, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 12 happen after Step 3?", "why_question": "Why must Step 12 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 12 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not depend on Step 3 and can happen at any time after Step 8."}
{"plan_idx": 491, "title": "almond and apple cake", "question_idx": 491, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 7], "binary_question": "Must Step 8 happen after Step 7?", "why_question": "Why must Step 8 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 must happen after Step 7 because the procedure calls for adding half the flour and half the milk, stirring until well combined, and then repeating with the remaining flour and milk."}
{"plan_idx": 492, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 492, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 involves mixing the flour with the butter, and Step 4 requires that mixture as a base to add the milk, egg yolk, and lemon zest."}
{"plan_idx": 493, "title": "strawberry-tiramisu-trifle", "question_idx": 493, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: The procedure does not specify that Step 7 must be done after Step 4."}
{"plan_idx": 494, "title": "strawberries-in-pimm-s", "question_idx": 494, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 (adding Pimm's) must happen after Step 3 (letting the strawberries and sugar sit for 15 minutes) because the strawberries need time to macerate in the sugar before the Pimm's is added."}
{"plan_idx": 495, "title": "jam-drop-biscuits", "question_idx": 495, "steps": ["Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.", "Sieve in flour and fold in.", "Chill for at least 30 minutes.", "Form small balls from the biscuit dough and roll in ground hazelnuts.", "Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.", "Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: jam-drop-biscuits\n\nProcedure:\n1. Beat butter until fluffy and gradually add the sugar, vanilla sugar and eggs.\n2. Sieve in flour and fold in.\n3. Chill for at least 30 minutes.\n4. Form small balls from the biscuit dough and roll in ground hazelnuts.\n5. Make a hollow into each ball with the end of a wooden spoon and place onto a baking tray lined with baking parchment.\n6. Fill the holes with jam and bake in a preheated oven at 170 C / Gas 3 for 20 minutes.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 3 does not depend on the results of Step 1 and can therefore be done at any time after Step 1."}
{"plan_idx": 496, "title": "vegetable-terrine", "question_idx": 496, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 13], "binary_question": "Must Step 14 happen after Step 5?", "why_question": "Why must Step 14 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 14 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 only applies if a silicone mold was not used, so it does not need to happen after Step 5."}
{"plan_idx": 497, "title": "creamy-chayote-squash-soup", "question_idx": 497, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 (simmer about 20 minutes) can happen after Step 5 (stir in the stock and 1 tablespoon coriander) because Steps 3, 4, and 6 do not depend on Step 2."}
{"plan_idx": 498, "title": "chocolate-pancake-batter", "question_idx": 498, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 (letting the batter rest for 20 minutes) must happen after Step 1 (sifting the flour and cocoa powder) because the batter needs to be made before it can be set aside to rest."}
{"plan_idx": 499, "title": "chocolate-pancake-batter", "question_idx": 499, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 must happen after Step 9 because Step 10 involves flipping the pancake, which is done after the pancake has been cooked on the first side."}
{"plan_idx": 500, "title": "shellabina-s-corned-beef-hash", "question_idx": 500, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 must happen after Step 2 because the corned beef must be added before the gravy granules."}
{"plan_idx": 501, "title": "spiced butternut squash soup", "question_idx": 501, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why must Step 13 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 13 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 (pureeing the soup) cannot be done before Step 1 (preheating the oven) because pureeing requires cooked squash, which is obtained after Step 1."}
{"plan_idx": 502, "title": "chocolate-chocolate-cake", "question_idx": 502, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 21], "binary_question": "Must Step 22 happen after Step 13?", "why_question": "Why must Step 22 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 22 does not directly depend on Step 13, as it is a step to decorate the cake, which can be done after the cake has cooled completely."}
{"plan_idx": 503, "title": "slow cooker butter chicken", "question_idx": 503, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Stirring in the ingredients in Step 3 does not have to happen immediately after heating the butter and vegetable oil in Step 1."}
{"plan_idx": 504, "title": "curried bbq mussels", "question_idx": 504, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 (cooking the mussels) does not have to happen after Step 6 (adding the red pepper and parsley)."}
{"plan_idx": 505, "title": "almond and apple cake", "question_idx": 505, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 11], "binary_question": "Must Step 12 happen after Step 3?", "why_question": "Why must Step 12 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 12 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because lining the cake tin with baking parchment (Step 3) is done before adding the cake batter (Step 12)."}
{"plan_idx": 506, "title": "tortellini-fritto-with-almond-butter", "question_idx": 506, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not depend on Step 1 being completed first, as the procedure only requires water to be boiled in step 1."}
{"plan_idx": 507, "title": "brown sugar shortbread", "question_idx": 507, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 involves adding flour and kneading, which should be done after the flour has been added in Step 5."}
{"plan_idx": 508, "title": "almond and apple cake", "question_idx": 508, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 10], "binary_question": "Must Step 11 happen after Step 6?", "why_question": "Why must Step 11 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 11 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: You must add the remaining flour and milk into the mixture before arranging the apple in the baking tin (Step 10)."}
{"plan_idx": 509, "title": "strawberry-tiramisu-trifle", "question_idx": 509, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The procedure specifies that the custard mixture is added in Step 7."}
{"plan_idx": 510, "title": "curried bbq mussels", "question_idx": 510, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Foil must be wrapped around the portions before cooking on the barbecue to ensure they are cooked evenly and retain their moisture."}
{"plan_idx": 511, "title": "strawberries-in-pimm-s", "question_idx": 511, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 is optional, so it can happen before or after Step 5."}
{"plan_idx": 512, "title": "lightly spiced tomato and red lentil soup", "question_idx": 512, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 (checking the consistency) requires the soup to have been blended, which is done in step 9."}
{"plan_idx": 513, "title": "spiced butternut squash soup", "question_idx": 513, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 11], "binary_question": "Must Step 12 happen after Step 4?", "why_question": "Why must Step 12 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 12 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 (mashing squash and potatoes) must happen after Step 4 (baking squash) because the squash needs to be cooked before it can be mashed."}
{"plan_idx": 514, "title": "chocolate-chocolate-cake", "question_idx": 514, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [16, 21], "binary_question": "Must Step 22 happen after Step 17?", "why_question": "Why must Step 22 happen after Step 17?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 17?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 22 (sifting icing sugar over the top for decoration) must happen after Step 17 (baking the cake) because the cake needs to be cooled completely before it can be decorated."}
{"plan_idx": 515, "title": "brown sugar shortbread", "question_idx": 515, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 (rolling the dough to 1cm thickness) requires the dough to be mixed well in Step 4, before it can be rolled out."}
{"plan_idx": 516, "title": "spiced-pumpkin-teabread", "question_idx": 516, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 11], "binary_question": "Must Step 12 happen after Step 7?", "why_question": "Why must Step 12 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 12 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not have to happen after Step 7 as there are other steps in between."}
{"plan_idx": 517, "title": "banana-split-cake", "question_idx": 517, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 (Slicing bananas) does not need to happen after Step 2 (Combining flour, 175g margarine and chopped pecans) as the two steps are not related and can be performed in any order."}
{"plan_idx": 518, "title": "simple-basic-cupcakes", "question_idx": 518, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8, which is checking the doneness of the cake, needs to be done after the cake has been baked in the oven in Step 7."}
{"plan_idx": 519, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 519, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 9], "binary_question": "Must Step 10 happen after Step 9?", "why_question": "Why must Step 10 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 10 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 involves serving the dish, which typically happens after all the ingredients have been cooked and combined (Step 9)."}
{"plan_idx": 520, "title": "no-sugar-rock-cakes", "question_idx": 520, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 1 (preheating oven) needs to be done before Step 8 (baking) because the oven needs to be at the correct temperature before the cakes can be baked."}
{"plan_idx": 521, "title": "easy strawberry tart", "question_idx": 521, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 (chill until well set) should happen after Step 5 (pour into the digestive biscuit base) to allow the tart to cool and set before serving."}
{"plan_idx": 522, "title": "cranachan", "question_idx": 522, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7, whipping cream and folding in other ingredients, does not need to happen after spreading oats on a baking tray."}
{"plan_idx": 523, "title": "fiery-bean-and-avocado-dip", "question_idx": 523, "steps": ["In a large bowl, mix blackeyed beans, tomatoes, red onion, Scotch bonnet chillies, Italian dressing and cayenne pepper.", "Stir in the avocados just before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fiery-bean-and-avocado-dip\n\nProcedure:\n1. In a large bowl, mix blackeyed beans, tomatoes, red onion, Scotch bonnet chillies, Italian dressing and cayenne pepper.\n2. Stir in the avocados just before serving.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 1 needs to be completed before Step 2 as it involves preparing the base for the dip before adding the avocados."}
{"plan_idx": 524, "title": "cranachan", "question_idx": 524, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 1-7 need to be completed before Step 8 because they prepare the ingredients for spooning into serving bowls."}
{"plan_idx": 525, "title": "spicy-tomato-anchovy-pasta", "question_idx": 525, "steps": ["Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;", "cook until lightly browned.", "Add anchovies and water, cover and simmer for 4 to 5 minutes.", "Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.", "While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.", "Add linguine and cook until al dente, about 7 to 8 minutes;", "drain.", "Toss with anchovy mixture and chilli flakes.", "If desired, season with black pepper.", "Serve immediately."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spicy-tomato-anchovy-pasta\n\nProcedure:\n1. Heat 6 tablespoons olive oil in a large frying pan over medium heat, then stir in garlic, broccoli and mushrooms;\n2. cook until lightly browned.\n3. Add anchovies and water, cover and simmer for 4 to 5 minutes.\n4. Stir in spring onions, tomatoes and parsley and cover again, simmering until vegetables are soft, about 3 to 4 minutes.\n5. While the vegetables are cooking, bring a large pot of water and one teaspoon of olive oil to the boil.\n6. Add linguine and cook until al dente, about 7 to 8 minutes;\n7. drain.\n8. Toss with anchovy mixture and chilli flakes.\n9. If desired, season with black pepper.\n10. Serve immediately.\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 (tossing with anchovy mixture and chili flakes) should happen after steps 5 to 7 (cooking linguine) to ensure the linguine is cooked properly"}
{"plan_idx": 526, "title": "spiced-pumpkin-teabread", "question_idx": 526, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (Sprinkle with the pumpkin seeds) does not have to happen after Step 3 (Steam the pumpkin flesh)."}
{"plan_idx": 527, "title": "cranachan", "question_idx": 527, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 must happen after Step 2 because the oats need to be toasted in the oven before they can be set aside to cool."}
{"plan_idx": 528, "title": "chicken and vegetable pie", "question_idx": 528, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 14], "binary_question": "Must Step 15 happen after Step 10?", "why_question": "Why must Step 15 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 15 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Steps 11 to 14 need to be completed before baking the pie in Step 15."}
{"plan_idx": 529, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 529, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 14], "binary_question": "Must Step 15 happen after Step 5?", "why_question": "Why must Step 15 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 15 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 should happen after Step 14, not Step 5."}
{"plan_idx": 530, "title": "chicken and vegetable pie", "question_idx": 530, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 12], "binary_question": "Must Step 13 happen after Step 11?", "why_question": "Why must Step 13 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 13 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 involves placing top pastry over the filling in the pie dish, which must be done after the filling is in place."}
{"plan_idx": 531, "title": "tangy-gammon-in-cider", "question_idx": 531, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not depend on Step 4, so it can happen at any time after Step 8."}
{"plan_idx": 532, "title": "curried bbq mussels", "question_idx": 532, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 can happen after any step as it is not dependent on any other step."}
{"plan_idx": 533, "title": "fusilli-and-meatballs", "question_idx": 533, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 3 must happen after Step 2 because the onion mixture is cooked after the onion and garlic are saut\u00e9ed."}
{"plan_idx": 534, "title": "chocolate-pancake-batter", "question_idx": 534, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 (greasing the pan) should happen after step 8 (cooking one side of the pancake)."}
{"plan_idx": 535, "title": "tortellini-fritto-with-almond-butter", "question_idx": 535, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 (serving the dish) should happen after Step 6 (frying the tortellini) as the tortellini needs to be cooked before it can be served."}
{"plan_idx": 536, "title": "very-vanilla-ry-cheesecake", "question_idx": 536, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why must Step 13 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 13 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13, covering the cheesecake and refrigerating it, should happen after all the other steps have been completed as it is the final step in the procedure."}
{"plan_idx": 537, "title": "fusilli-and-meatballs", "question_idx": 537, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 15], "binary_question": "Must Step 16 happen after Step 4?", "why_question": "Why must Step 16 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 16 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16 does not have to happen after Step 4 because it involves draining the meatballs on kitchen paper, which is not dependent on the transfer of onion mixture to a bowl in Step 4."}
{"plan_idx": 538, "title": "busters-liver-dinner", "question_idx": 538, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not have to happen after Step 5 because you can microwave the mixture before dividing it between plastic tubs."}
{"plan_idx": 539, "title": "fusilli-and-meatballs", "question_idx": 539, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 16], "binary_question": "Must Step 17 happen after Step 6?", "why_question": "Why must Step 17 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 17 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 17, adding the meatballs to the tomato sauce, can be done after any step where the tomato sauce is made or heated."}
{"plan_idx": 540, "title": "almond and apple cake", "question_idx": 540, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 12], "binary_question": "Must Step 13 happen after Step 7?", "why_question": "Why must Step 13 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 13 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Arranging the apple in the tin (Step 10) and spooning the mixture into the tin (Step 11) must take place before setting the cake aside to cool (Step 13)."}
{"plan_idx": 541, "title": "chicken-prawn-and-rice-soup", "question_idx": 541, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 (returning to the boil after adding salt and sherry) occurs after Step 9 (reducing heat and allowing to simmer)."}
{"plan_idx": 542, "title": "spiced-pumpkin-teabread", "question_idx": 542, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why must Step 11 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 11 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 11 (bake the loaf) should be done after Step 8 (add the pumpkin mixture and mix well) because the ingredients need to be combined and mixed before baking."}
{"plan_idx": 543, "title": "warm-puy-lentil-and-tomato-salad", "question_idx": 543, "steps": ["Bring a large pan of water to the boil;", "add lentils and cook over low heat for 30 minutes.", "Put tomatoes in a small bowl and season with salt.", "Set aside for 15 minutes.", "Drain lentils and tomatoes and mix together.", "Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: warm-puy-lentil-and-tomato-salad\n\nProcedure:\n1. Bring a large pan of water to the boil;\n2. add lentils and cook over low heat for 30 minutes.\n3. Put tomatoes in a small bowl and season with salt.\n4. Set aside for 15 minutes.\n5. Drain lentils and tomatoes and mix together.\n6. Distribute mixture evenly in 6 individual bowls or ramekins, sprinkle with chopped parsley and serve warm or chilled.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 must happen after Step 5 because Step 5 mixes the lentils and tomatoes together, and Step 6 distributes the mixture into bowls."}
{"plan_idx": 544, "title": "cranachan", "question_idx": 544, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 requires the cream to be whipped to firm peaks, which is done in Step 6."}
{"plan_idx": 545, "title": "tomato and basil salad", "question_idx": 545, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 2], "binary_question": "Must Step 3 happen after Step 1?", "why_question": "Why must Step 3 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 3 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 3 does not depend on Step 1 happening first."}
{"plan_idx": 546, "title": "white bread", "question_idx": 546, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 10], "binary_question": "Must Step 11 happen after Step 5?", "why_question": "Why must Step 11 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 11 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, the procedure requires the dough to rise before shaping into loaves."}
{"plan_idx": 547, "title": "chocolate-chocolate-cake", "question_idx": 547, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The flour needs to be added to the creamy butter and margarine mixture before the chocolate is added."}
{"plan_idx": 548, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 548, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 13], "binary_question": "Must Step 14 happen after Step 8?", "why_question": "Why must Step 14 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 14 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 14, splitting the shortcakes in half, must happen after Step 8, placing the shortcakes on a baking tray, because the shortcakes need to be baked before they can be split in half."}
{"plan_idx": 549, "title": "chicken-prawn-and-rice-soup", "question_idx": 549, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 6], "binary_question": "Must Step 7 happen after Step 1?", "why_question": "Why must Step 7 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 7 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 (adding salt and sherry) can be done after Steps 6-9, as it involves seasoning the broth after boiling."}
{"plan_idx": 550, "title": "vegetable-terrine", "question_idx": 550, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 12 happen after Step 11?", "why_question": "Why must Step 12 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 12 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 (pouring the remaining cream mixture on top) must happen after Step 11 (arranging the vegetables) because the vegetables need to be arranged before the cream mixture is added."}
{"plan_idx": 551, "title": "spiced butternut squash soup", "question_idx": 551, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 can happen after Step 4, because the squash needs to be baked before it can be cooled and peeled."}
{"plan_idx": 552, "title": "almond and apple cake", "question_idx": 552, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 12 happen after Step 8?", "why_question": "Why must Step 12 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 12 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 should happen after step 11 as the mixture needs to be spooned into the tin and smoothed before baking."}
{"plan_idx": 553, "title": "white bread", "question_idx": 553, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not depend on Step 3, as it follows kneading the dough on a lightly floured surface."}
{"plan_idx": 554, "title": "tomato and basil salad", "question_idx": 554, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 1 instructs the reader to grab an attractive serving plate, which is necessary before tomatoes can be sliced and scattered onto the plate in Step 2."}
{"plan_idx": 555, "title": "almond and apple cake", "question_idx": 555, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 12], "binary_question": "Must Step 13 happen after Step 6?", "why_question": "Why must Step 13 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 13 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 involves cooling the cake after baking, while Step 6 involves adding ground almonds to the batter. These steps do not rely on each other and can occur independently."}
{"plan_idx": 556, "title": "strawberries-in-pimm-s", "question_idx": 556, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not require the outcome of Step 3 to be completed first."}
{"plan_idx": 557, "title": "spiced-pumpkin-teabread", "question_idx": 557, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 involves sprinkling pumpkin seeds on the mixture, and it can be done after Step 8 when the pumpkin mixture is added and beaten."}
{"plan_idx": 558, "title": "lightly spiced tomato and red lentil soup", "question_idx": 558, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not have to happen after Step 4 because there are other intermediate steps such as adding the lentils, stock, tomatoes, tomato puree and bay leaf (Step 5) and simmering the soup for 25-30 minutes (Step 6)."}
{"plan_idx": 559, "title": "curried bbq mussels", "question_idx": 559, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 8], "binary_question": "Must Step 9 happen after Step 1?", "why_question": "Why must Step 9 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 9 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9, cooking the mussels, can happen after any of the preceding steps as long as Step 1, preheating the barbecue, is done first."}
{"plan_idx": 560, "title": "strawberries-in-pimm-s", "question_idx": 560, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 does not have to happen after Step 2 as it does not depend on the outcome of Step 2."}
{"plan_idx": 561, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 561, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The tuna should be stirred in after the peppers have been mixed in, as per Step 9 of the procedure."}
{"plan_idx": 562, "title": "fusilli-and-meatballs", "question_idx": 562, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 involves blending the tomatoes to form a smooth sauce, which should be added to the saucepan before bringing to the boil in Step 7."}
{"plan_idx": 563, "title": "fusilli-and-meatballs", "question_idx": 563, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 12], "binary_question": "Must Step 13 happen after Step 3?", "why_question": "Why must Step 13 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 13 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 (shape into 20 meatballs) requires the onion mixture from Step 3, so it must happen after Step 3."}
{"plan_idx": 564, "title": "chocolate-pancake-batter", "question_idx": 564, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 must happen after Step 2 because the eggs need to be whisked into a well made in the centre of the sifted flour and cocoa powder."}
{"plan_idx": 565, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 565, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not have to happen after Step 2 because the grapefruit juice needed for Step 7 is collected in Step 4."}
{"plan_idx": 566, "title": "strawberries-in-pimm-s", "question_idx": 566, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 4], "binary_question": "Must Step 5 happen after Step 1?", "why_question": "Why must Step 5 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 5 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 must happen after Step 1 because the Pimm's is added to the strawberries in Step 5."}
{"plan_idx": 567, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 567, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not depend on Step 4 as it involves mixing the drained and sliced roasted red peppers into the mushrooms after they have been coated with a little sauce."}
{"plan_idx": 568, "title": "white bread", "question_idx": 568, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 9], "binary_question": "Must Step 10 happen after Step 4?", "why_question": "Why must Step 10 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 10 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (dividing the dough in half) can happen after Step 9 (punching the dough down)."}
{"plan_idx": 569, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 569, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 15], "binary_question": "Must Step 16 happen after Step 8?", "why_question": "Why must Step 16 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 16 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The procedure specifies that the shortcake top and remaining berries and cream should be added after assembling the shortcakes in Step 15, which in turn happens after Step 8."}
{"plan_idx": 570, "title": "vegetable-terrine", "question_idx": 570, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 14], "binary_question": "Must Step 15 happen after Step 1?", "why_question": "Why must Step 15 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 15 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 (serving chilled) should happen after Step 13 (refrigerate the terrine for several hours until firm)."}
{"plan_idx": 571, "title": "very-vanilla-ry-cheesecake", "question_idx": 571, "steps": ["Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.", "Place the biscuits into a plastic bag and crush with a rolling pin.", "Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.", "Drizzle the crumbs with melted butter and stir to combine.", "Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.", "Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.", "Beat in the eggs one at a time, incorporating each egg before adding the next one.", "Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.", "Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.", "Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.", "Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.", "Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.", "Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 11], "binary_question": "Must Step 12 happen after Step 8?", "why_question": "Why must Step 12 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: very-vanilla-ry-cheesecake\n\nProcedure:\n1. Preheat oven to 150 C / Gas 2 and lightly butter a 26cm springform tin.\n2. Place the biscuits into a plastic bag and crush with a rolling pin.\n3. Pour the crumbs into a bowl and mix with the scraped seeds of 1 vanilla bean.\n4. Drizzle the crumbs with melted butter and stir to combine.\n5. Press the crumb mixture firmly into the bottom and up the sides of the springform tin and set aside.\n6. Place the softened cream cheese and sugar into the work bowl of an electric mixer and beat for about 3 minutes on Medium speed, until the mixture is smooth.\n7. Beat in the eggs one at a time, incorporating each egg before adding the next one.\n8. Add the scraped seeds of 2 vanilla beans, vanilla extract, soured cream and double cream and beat on Medium-High speed for about 1 minute, until the mixture is blended and smooth.\n9. Pour the mixture into the biscuit base, leaving about 5cm of space from the top of the tin for the cake to expand as it bakes.\n10. Place a baking dish onto the bottom rack of the preheated oven and fill it halfway with boiling water.\n11. Place the cheesecake onto the middle rack, above the tin of boiling water and bake until a small knife inserted into the middle of the cheesecake comes out clean, about 1 hour and 20 minutes.\n12. Turn the oven off and let the cheesecake cool down inside the oven for 1 hour.\n13. Cover the cheesecake with cling film, then foil and refrigerate at least 4 hours or overnight before serving.\n\n\n1. Must Step 12 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 does not depend on Step 8 happening first, as it involves cooling the cheesecake after baking."}
{"plan_idx": 572, "title": "chocolate-pancake-batter", "question_idx": 572, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 must happen after Step 2 because the beaten eggs are added in Step 2 and need to be whisked into the flour and cocoa powder mixture before the milk, melted butter, and sugar are added in Step 3."}
{"plan_idx": 573, "title": "chocolate-chocolate-cake", "question_idx": 573, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 16], "binary_question": "Must Step 17 happen after Step 1?", "why_question": "Why must Step 17 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 17 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 17 must happen after Step 1 because the oven needs to be preheated before the cake mixture can be baked."}
{"plan_idx": 574, "title": "spiced butternut squash soup", "question_idx": 574, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Chicken stock is needed to cook the potatoes and soften them, so Step 9 must happen after Step 8."}
{"plan_idx": 575, "title": "spiced-pumpkin-teabread", "question_idx": 575, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 12], "binary_question": "Must Step 13 happen after Step 4?", "why_question": "Why must Step 13 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 13 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 does not depend on Step 4 and can be done after Step 12."}
{"plan_idx": 576, "title": "chocolate-chocolate-cake", "question_idx": 576, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [15, 21], "binary_question": "Must Step 22 happen after Step 16?", "why_question": "Why must Step 22 happen after Step 16?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 16?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 22 involves sifting icing sugar over the cake for decoration, which should be done after the cake has been baked and cooled, as specified in Step 16."}
{"plan_idx": 577, "title": "white bread", "question_idx": 577, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 should happen after Step 10, where the dough is divided in half and shaped into loaves."}
{"plan_idx": 578, "title": "slow cooker butter chicken", "question_idx": 578, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 must happen after Step 3 because the onion needs to soften in order for the curry powder, curry paste, tandoori masala, garam masala and tomato puree to be stirred in smoothly."}
{"plan_idx": 579, "title": "almost no fat banana bread", "question_idx": 579, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not depend on Step 3 to be completed first."}
{"plan_idx": 580, "title": "white bread", "question_idx": 580, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 12 happen after Step 2?", "why_question": "Why must Step 12 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 12 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 involves allowing the dough to rise for the second time, while Step 2 is about proofing the yeast."}
{"plan_idx": 581, "title": "white bread", "question_idx": 581, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 12], "binary_question": "Must Step 13 happen after Step 3?", "why_question": "Why must Step 13 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 13 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because other steps, such as allowing the dough to rise, shaping it, and giving it a second rise, must be completed before baking."}
{"plan_idx": 582, "title": "chicken-prawn-and-rice-soup", "question_idx": 582, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 12], "binary_question": "Must Step 13 happen after Step 11?", "why_question": "Why must Step 13 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 13 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 (serving and enjoying the soup) cannot be done until the rice has been browned and added to the soup in step 12."}
{"plan_idx": 583, "title": "tomato and basil salad", "question_idx": 583, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 must happen after Step 2 because the tomatoes need to be sliced and scattered on the plate before the basil leaves can be added."}
{"plan_idx": 584, "title": "balsamic-and-mozzarella-chicken", "question_idx": 584, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 must happen after Step 2 because the marinade must be discarded after being used to marinate the chicken."}
{"plan_idx": 585, "title": "white bread", "question_idx": 585, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Punching down the dough after the first rise helps to remove air bubbles and gets the dough ready for shaping and the second rise."}
{"plan_idx": 586, "title": "easy strawberry tart", "question_idx": 586, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3, \"Remove from heat\", must happen after Step 2, \"Boil for one minute\", because you need to stop boiling the mixture before you can remove it from the heat."}
{"plan_idx": 587, "title": "banana-split-cake", "question_idx": 587, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 10], "binary_question": "Must Step 11 happen after Step 8?", "why_question": "Why must Step 11 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 11 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 11 involves covering the cake with whipped cream, which must be done after the filling, bananas, pineapple, and strawberries have been layered in previous steps."}
{"plan_idx": 588, "title": "cloud-bread", "question_idx": 588, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 can happen after Step 6 because Step 5 is about beating the egg whites and baking powder together until stiff peaks form."}
{"plan_idx": 589, "title": "cranachan", "question_idx": 589, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (garnishing with a mint leaf) is an optional touch and can be done at any time after Step 9 (drizzling with whisky)."}
{"plan_idx": 590, "title": "chocolate-chocolate-cake", "question_idx": 590, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 15], "binary_question": "Must Step 16 happen after Step 11?", "why_question": "Why must Step 16 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 16 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 and Step 16 can be done in any order as both steps do not require the result of the other step to be completed."}
{"plan_idx": 591, "title": "easy strawberry tart", "question_idx": 591, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 3, 4 and 5 must be completed before step 6."}
{"plan_idx": 592, "title": "curried bbq mussels", "question_idx": 592, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 (sprinkling red pepper and parsley) can be done before or after Step 3 (arranging foil on a flat surface)."}
{"plan_idx": 593, "title": "spiced butternut squash soup", "question_idx": 593, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 12 happen after Step 2?", "why_question": "Why must Step 12 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 12 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 12 and 2 are not related, so Step 12 does not have to happen after Step 2."}
{"plan_idx": 594, "title": "chicken and vegetable pie", "question_idx": 594, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 13], "binary_question": "Must Step 14 happen after Step 3?", "why_question": "Why must Step 14 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 14 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 does not depend on Step 3, as it involves making slits in the pastry cover, which can be done at any point after the pastry has been added to the pie dish."}
{"plan_idx": 595, "title": "strawberry-tiramisu-trifle", "question_idx": 595, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 specifies leaving the finished trifle in the fridge for at least 4 hours, so it should come after all the other steps."}
{"plan_idx": 596, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 596, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (removing the shortcakes to cool) can happen after Step 9 (baking them) because it does not depend on Step 3 (rubbing the butter into the flour)."}
{"plan_idx": 597, "title": "chicken-prawn-and-rice-soup", "question_idx": 597, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Draining the prawns and chicken mixture must happen after cooking them in hot oil."}
{"plan_idx": 598, "title": "banana-split-cake", "question_idx": 598, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 10 (layering strawberries over bananas) must happen after Step 8 (spreading the filling over the cooled base) because the strawberries go on top of the bananas, which are placed on the filling."}
{"plan_idx": 599, "title": "white bread", "question_idx": 599, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 12], "binary_question": "Must Step 13 happen after Step 1?", "why_question": "Why must Step 13 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 13 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 (baking) must happen after Step 12 (second rise), as the dough needs to rise before it can be baked."}
{"plan_idx": 600, "title": "vegetable-terrine", "question_idx": 600, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 7], "binary_question": "Must Step 8 happen after Step 1?", "why_question": "Why must Step 8 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 8 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not directly depend on Step 1 for its completion."}
{"plan_idx": 601, "title": "banana-split-cake", "question_idx": 601, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 (beat the margarine, eggs and icing sugar) must happen after Step 6 (combine the ingredients) in order to create the fluffy filling."}
{"plan_idx": 602, "title": "chicken and vegetable pie", "question_idx": 602, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 13], "binary_question": "Must Step 14 happen after Step 2?", "why_question": "Why must Step 14 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 14 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 does not depend on Step 2 and can be done after any of the other steps."}
{"plan_idx": 603, "title": "fusilli-and-meatballs", "question_idx": 603, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 12 happen after Step 2?", "why_question": "Why must Step 12 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 12 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 can be done before Step 2 because it does not depend on the outcome of Step 2."}
{"plan_idx": 604, "title": "tangy-gammon-in-cider", "question_idx": 604, "steps": ["Preheat the oven to 200 degrees /gas mark 6.", "Start by piercing each tomato once and covering with boiling water to loosen the skins.", "Drain the onions and chop each one in half.", "Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.", "Put the onions, tomatoes and apples into a casserole dish.", "Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.", "Place in the dish and repeat with the other gammon steaks.", "Pour cider over the steaks, cover the top with a lid or tin foil.", "Cook for 1 hour."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tangy-gammon-in-cider\n\nProcedure:\n1. Preheat the oven to 200 degrees /gas mark 6.\n2. Start by piercing each tomato once and covering with boiling water to loosen the skins.\n3. Drain the onions and chop each one in half.\n4. Once the tomatoes have been in the water for 5 minutes, drain, then remove the skins and coarsely chop into largish pieces.\n5. Put the onions, tomatoes and apples into a casserole dish.\n6. Take a gammon steak, lay flat, and spoon some of the mixture into the middle, then wrap the sides of the steak over the top and secure with a small skewer or piece of raw spaghetti.\n7. Place in the dish and repeat with the other gammon steaks.\n8. Pour cider over the steaks, cover the top with a lid or tin foil.\n9. Cook for 1 hour.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 (placing the gammon steaks in the dish) requires the onions and tomatoes to be prepared, which occurs in Step 3."}
{"plan_idx": 605, "title": "brown sugar shortbread", "question_idx": 605, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not need to be completed after step 4 because there are other steps in between that need to be completed first, such as mixing the dough and rolling it out."}
{"plan_idx": 606, "title": "rouille", "question_idx": 606, "steps": ["In a mortar, crush the garlic to a fine mash.", "Transfer to a mixing bowl.", "Add the egg yolks, and beat into a mayonnaise while adding the olive oil.", "When the sauce is thick and smooth, stir in the cayenne pepper and saffron."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: rouille\n\nProcedure:\n1. In a mortar, crush the garlic to a fine mash.\n2. Transfer to a mixing bowl.\n3. Add the egg yolks, and beat into a mayonnaise while adding the olive oil.\n4. When the sauce is thick and smooth, stir in the cayenne pepper and saffron.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 4 involves adding cayenne pepper and saffron to the sauce, which can be done at any time after Step 3, when the mayonnaise is made."}
{"plan_idx": 607, "title": "busters-liver-dinner", "question_idx": 607, "steps": ["Put all ingredients into a slow cooker, mix together.", "Put slow cooker on high for 4 to 5 hours or low all day.", "( If mixture starts to look too dry just add a little hot water.", ")", "Once cooked, divide between several plastic microwaveable tubs with lids.", "This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.", "When ready to eat microwave with lid half off for 2 to 3 minutes on medium high."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: busters-liver-dinner\n\nProcedure:\n1. Put all ingredients into a slow cooker, mix together.\n2. Put slow cooker on high for 4 to 5 hours or low all day.\n3. ( If mixture starts to look too dry just add a little hot water.\n4. )\n5. Once cooked, divide between several plastic microwaveable tubs with lids.\n6. This mixture usually makes 6 to 7 meals, I freeze 4 and put the rest in the fridge.\n7. When ready to eat microwave with lid half off for 2 to 3 minutes on medium high.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 (dividing the mixture into tubs) can be done before or after Step 2 (cooking the mixture in the slow cooker), as long as the mixture is divided before it is cooked."}
{"plan_idx": 608, "title": "spiced butternut squash soup", "question_idx": 608, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 14], "binary_question": "Must Step 15 happen after Step 3?", "why_question": "Why must Step 15 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 15 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 does not depend on the completion of Step 3 and can be performed at any point after Step 14 is complete."}
{"plan_idx": 609, "title": "spiced-guava-cake", "question_idx": 609, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 5], "binary_question": "Must Step 6 happen after Step 5?", "why_question": "Why must Step 6 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 6 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The butter and sugar need to be creamed together before the eggs are added."}
{"plan_idx": 610, "title": "chocolate-chocolate-cake", "question_idx": 610, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [17, 21], "binary_question": "Must Step 22 happen after Step 18?", "why_question": "Why must Step 22 happen after Step 18?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 18?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 22 (sifting icing sugar lightly over the top for decoration) is not a necessary step for the cake to be baked and cooled, which is the purpose of Step 18."}
{"plan_idx": 611, "title": "spiced-pumpkin-teabread", "question_idx": 611, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 11], "binary_question": "Must Step 12 happen after Step 11?", "why_question": "Why must Step 12 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 12 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 12 instructs the baker to allow the loaf to cool in the tin for 10 minutes before turning it out onto a wire rack, which must be done after the loaf has been baked in Step 11."}
{"plan_idx": 612, "title": "no-sugar-rock-cakes", "question_idx": 612, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 6], "binary_question": "Must Step 7 happen after Step 2?", "why_question": "Why must Step 7 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 7 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not depend on Step 2 happening first."}
{"plan_idx": 613, "title": "easy strawberry tart", "question_idx": 613, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 (pouring the mixture into the biscuit base) must happen after Step 4 (stirring in the sliced strawberries and tossing until well coated)."}
{"plan_idx": 614, "title": "strawberry-tiramisu-trifle", "question_idx": 614, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 8], "binary_question": "Must Step 9 happen after Step 7?", "why_question": "Why must Step 9 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 9 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not need to happen after Step 7, as the order of these steps does not affect the final outcome of the recipe."}
{"plan_idx": 615, "title": "spanish-rabbit-stew", "question_idx": 615, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 9], "binary_question": "Must Step 10 happen after Step 1?", "why_question": "Why must Step 10 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 10 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 can be done after any other step in the procedure, as it does not require any specific ingredients or conditions from the previous steps."}
{"plan_idx": 616, "title": "spiced-guava-cake", "question_idx": 616, "steps": ["Preheat oven to 180 C / Gas 4.", "Grease and flour one 23x13cm loaf tin.", "Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.", "In another bowl, mix together guava pulp and juice.", "In another bowl, cream together butter and sugar.", "Add eggs, one at a time.", "Add flour mixture and guava mixture alternately to creamed mixture.", "Pour batter into prepared tin.", "Bake at 180 C / Gas 4 for 30-35 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 8], "binary_question": "Must Step 9 happen after Step 4?", "why_question": "Why must Step 9 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-guava-cake\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Grease and flour one 23x13cm loaf tin.\n3. Sieve together flour, cornflour, nutmeg, bicarbonate of soda, cinnamon and cloves.\n4. In another bowl, mix together guava pulp and juice.\n5. In another bowl, cream together butter and sugar.\n6. Add eggs, one at a time.\n7. Add flour mixture and guava mixture alternately to creamed mixture.\n8. Pour batter into prepared tin.\n9. Bake at 180 C / Gas 4 for 30-35 minutes.\n\n\n1. Must Step 9 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not depend on the completion of Step 4 and can occur after any of the other steps."}
{"plan_idx": 617, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 617, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 (adding mushrooms) must happen after Step 2 (softening the onion) because the mushrooms need to be cooked in the oil and onion mixture."}
{"plan_idx": 618, "title": "fusilli-and-meatballs", "question_idx": 618, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [13, 16], "binary_question": "Must Step 17 happen after Step 14?", "why_question": "Why must Step 17 happen after Step 14?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 17 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 17 does not need to happen after Step 14 because the meatballs only need to be browned on all sides and do not need to be cooked through at this point."}
{"plan_idx": 619, "title": "white bread", "question_idx": 619, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 9 (Punch dough down) must happen after Step 8 (Allow to rise until doubled in bulk) because the dough needs to rise before it can be punched down."}
{"plan_idx": 620, "title": "curried bbq mussels", "question_idx": 620, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The mussels must be divided and arranged on the foil before the curry mixture can be dotted on them."}
{"plan_idx": 621, "title": "lightly spiced tomato and red lentil soup", "question_idx": 621, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 8], "binary_question": "Must Step 9 happen after Step 5?", "why_question": "Why must Step 9 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 9 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not need to happen after Step 5 because steps 6-8 can be completed before blending the soup in step 9."}
{"plan_idx": 622, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 622, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 instructs you to cook the mushrooms until they are evenly coated with a little sauce, which requires them to have already given up their juices (which happens in Step 4)."}
{"plan_idx": 623, "title": "smoked-salmon-and-grapefruit-salad", "question_idx": 623, "steps": ["Top and tail the grapefruits.", "Slice the skin off the grapefruit over a bowl.", "This is to catch any juices.", "Using a small knife, segment the grapefruits over the juice bowl.", "Arrange the lamb's lettuce onto each serving plate or a large salad bowl.", "Top with grapefruit segments and smoked salmon.", "Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.", "Pour over the salad and serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: smoked-salmon-and-grapefruit-salad\n\nProcedure:\n1. Top and tail the grapefruits.\n2. Slice the skin off the grapefruit over a bowl.\n3. This is to catch any juices.\n4. Using a small knife, segment the grapefruits over the juice bowl.\n5. Arrange the lamb's lettuce onto each serving plate or a large salad bowl.\n6. Top with grapefruit segments and smoked salmon.\n7. Mix together 1 pinch of cracked peppercorns and 1 tablespoon grapefruit juice from the bowl.\n8. Pour over the salad and serve.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 2 (slicing the skin off the grapefruit) and Step 6 (topping with grapefruit segments and smoked salmon) are not dependent on each other; they can be done in any order."}
{"plan_idx": 624, "title": "spiced butternut squash soup", "question_idx": 624, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 13], "binary_question": "Must Step 14 happen after Step 9?", "why_question": "Why must Step 14 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 14 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step fourteen is \"return to the pot\", which does not need to happen after step 9: \"pour the chicken stock into the pot\"."}
{"plan_idx": 625, "title": "strawberry-tiramisu-trifle", "question_idx": 625, "steps": ["Set 3 strawberries for the garnish aside, and cut the rest into slices.", "In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.", "Then stir in the custard and finally fold in the whipped cream.", "Brush the sponge fingers with the remaining coffee.", "Line a glass bowl with one layer of the soaked sponge fingers.", "Spread half of the strawberries over the sponge fingers.", "Sprinkle half of the grated chocolate over that and then half of the custard mixture.", "Repeat the layers in order again.", "Cut the remaining 3 strawberries in half and lay them on top of the trifle.", "Cover and leave in the fridge for at least 4 hours, best overnight."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberry-tiramisu-trifle\n\nProcedure:\n1. Set 3 strawberries for the garnish aside, and cut the rest into slices.\n2. In a large bowl, beat the cream cheese with a hand whisk until creamy, gradually adding 2 tablespoons of the coffee.\n3. Then stir in the custard and finally fold in the whipped cream.\n4. Brush the sponge fingers with the remaining coffee.\n5. Line a glass bowl with one layer of the soaked sponge fingers.\n6. Spread half of the strawberries over the sponge fingers.\n7. Sprinkle half of the grated chocolate over that and then half of the custard mixture.\n8. Repeat the layers in order again.\n9. Cut the remaining 3 strawberries in half and lay them on top of the trifle.\n10. Cover and leave in the fridge for at least 4 hours, best overnight.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The sponge fingers must be soaked in coffee before lining the glass bowl."}
{"plan_idx": 626, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 626, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 (blanching the spinach leaves) needs to be done before Step 8 (grilling the spinach rolls) because the spinach leaves need to be softened before they can be wrapped around the cheese mixture and grilled."}
{"plan_idx": 627, "title": "creamy-chayote-squash-soup", "question_idx": 627, "steps": ["Dissolve the stock in the hot water.", "Melt the butter in a large saucepan over medium heat.", "Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.", "Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.", "Stir in the stock and 1 tablespoon coriander;", "cover.", "Simmer about 20 minutes.", "Pour the mixture into a liquidiser and puree until smooth.", "Pour into bowls and garnish with a sprig of coriander to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 6], "binary_question": "Must Step 7 happen after Step 3?", "why_question": "Why must Step 7 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: creamy-chayote-squash-soup\n\nProcedure:\n1. Dissolve the stock in the hot water.\n2. Melt the butter in a large saucepan over medium heat.\n3. Cook and stir the onion, garlic and crushed chillies in the butter until the onion is soft.\n4. Add the squash, 2 tablespoons coriander, salt and pepper and stir continuously for 5 minutes.\n5. Stir in the stock and 1 tablespoon coriander;\n6. cover.\n7. Simmer about 20 minutes.\n8. Pour the mixture into a liquidiser and puree until smooth.\n9. Pour into bowls and garnish with a sprig of coriander to serve.\n\n\n1. Must Step 7 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 7 does not rely on any steps that come before step 3."}
{"plan_idx": 628, "title": "almond and apple cake", "question_idx": 628, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 7], "binary_question": "Must Step 8 happen after Step 5?", "why_question": "Why must Step 8 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 8 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 Add ground almonds must happen after Step 7 Add half the flour and half the milk."}
{"plan_idx": 629, "title": "scone-pastry", "question_idx": 629, "steps": ["Sift the flour, baking powder and salt into a bowl.", "Add the butter and rub in until the mixture resembles fine crumbs.", "Make a well in the centre and add the milk.", "Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.", "Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: scone-pastry\n\nProcedure:\n1. Sift the flour, baking powder and salt into a bowl.\n2. Add the butter and rub in until the mixture resembles fine crumbs.\n3. Make a well in the centre and add the milk.\n4. Mix with a wooden spoon or your fingers to make a fairly soft but not sticky dough, adding a little more milk if necessary.\n5. Transfer the dough to a lightly floured surface and knead briefly, then roll out and use as required.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, Step 5 does not have to happen after Step 2 because Step 3 and Step 4 need to be completed first."}
{"plan_idx": 630, "title": "fusilli-and-meatballs", "question_idx": 630, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 17], "binary_question": "Must Step 18 happen after Step 11?", "why_question": "Why must Step 18 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 18 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 18 does not depend on Step 11 as they occur in different parts of the recipe for the meatballs and pasta, respectively."}
{"plan_idx": 631, "title": "spanish-rabbit-stew", "question_idx": 631, "steps": ["After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?", ").", "I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.", "Pour in half pint of white wine and half pint of water.", "You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.", "Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.", "Turn your slow cooker on to low power, let it simmer for about 5 hours.", "If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!", "Flavour with salt and pepper to taste.", "Cook the pasta according to the packet instructions, and serve with pasta.", "Most importantly, enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spanish-rabbit-stew\n\nProcedure:\n1. After slicing all of your ingredients, throw them all into your slow cooker (everything in at once, couldn\u2019t be easier right?\n2. ).\n3. I like to mix mine up, so I can take a big scoop and get a lovely mix of goodness.\n4. Pour in half pint of white wine and half pint of water.\n5. You might want to add a little more of each to cover your ingredients but the key rule is to keep the mixture 50/50.\n6. Make sure your tarragon and bay leaf aren\u2019t floating on the top or it won't let off any real flavour.\n7. Turn your slow cooker on to low power, let it simmer for about 5 hours.\n8. If your aren\u2019t hungry once that wonderful smell fills the room, I\u2019ll refund the cost of the ingredients!\n9. Flavour with salt and pepper to taste.\n10. Cook the pasta according to the packet instructions, and serve with pasta.\n11. Most importantly, enjoy!\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: The procedure does not specify that Step 4 must happen after Step 1, and it is possible to add the white wine and water before slicing the ingredients."}
{"plan_idx": 632, "title": "cloud-bread", "question_idx": 632, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 involves preparing the egg whites and baking powder, which are then folded into the cream cheese and egg yolk mixture in Step 6."}
{"plan_idx": 633, "title": "chocolate-chocolate-cake", "question_idx": 633, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 20], "binary_question": "Must Step 21 happen after Step 13?", "why_question": "Why must Step 21 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 21 (removing the cake from the tin) must happen after Step 13 (folding the egg white mixture into the chocolate mixture) because the folding process adds air and volume to the cake batter, and removing the cake from the tin too early would cause the batter to deflate."}
{"plan_idx": 634, "title": "lamb-curry--serves-4-", "question_idx": 634, "steps": ["Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.", "Fry the lamb in a little oil, then add the remaining onion.", "Gently fry for a minute, then add the paste and cook for a couple of minutes.", "Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.", "Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lamb-curry--serves-4-\n\nProcedure:\n1. Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.\n2. Fry the lamb in a little oil, then add the remaining onion.\n3. Gently fry for a minute, then add the paste and cook for a couple of minutes.\n4. Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.\n5. Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 (adding the water, tomatoes, and other ingredients) must happen after Step 3 (cooking the paste) because the paste needs to be cooked before the other ingredients are added."}
{"plan_idx": 635, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 635, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 15], "binary_question": "Must Step 16 happen after Step 2?", "why_question": "Why must Step 16 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 16 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 16 does not depend on Step 2 being completed first."}
{"plan_idx": 636, "title": "simple-basic-cupcakes", "question_idx": 636, "steps": ["Preheat oven to 180 C / Gas 4.", "Beat butter and sugar together until light and fluffy.", "Add the eggs, one at a time, beating after each addition.", "If the batter is too thick, stir in some milk.", "Gradually add the flour, mixing well each time until evenly mixed.", "Spoon tablespoons of batter into a greased muffin tin.", "Bake in preheated oven for 15-20 minutes.", "The cake is done when a skewer inserted to the cake comes out clean.", "Let rest for fives minutes, then allow to cool fully on a wire rack.", "Decorate, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: simple-basic-cupcakes\n\nProcedure:\n1. Preheat oven to 180 C / Gas 4.\n2. Beat butter and sugar together until light and fluffy.\n3. Add the eggs, one at a time, beating after each addition.\n4. If the batter is too thick, stir in some milk.\n5. Gradually add the flour, mixing well each time until evenly mixed.\n6. Spoon tablespoons of batter into a greased muffin tin.\n7. Bake in preheated oven for 15-20 minutes.\n8. The cake is done when a skewer inserted to the cake comes out clean.\n9. Let rest for fives minutes, then allow to cool fully on a wire rack.\n10. Decorate, if desired.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 involves baking the cupcakes, which requires the batter to be in the muffin tin, which is filled in Step 6."}
{"plan_idx": 637, "title": "banana-split-cake", "question_idx": 637, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 (removing the cake from the oven and allowing it to cool) must happen after Step 2 (baking the cake) as the cake needs to be baked before it can be removed from the oven and cooled."}
{"plan_idx": 638, "title": "lightly spiced tomato and red lentil soup", "question_idx": 638, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 9 (blending the soup) requires the bay leaf to be removed first, and this is done in Step 8."}
{"plan_idx": 639, "title": "chicken-prawn-and-rice-soup", "question_idx": 639, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 12], "binary_question": "Must Step 13 happen after Step 3?", "why_question": "Why must Step 13 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 13 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 13 (serving and enjoying) does not depend on Step 3 (cooking and draining the prawn and chicken mixture)."}
{"plan_idx": 640, "title": "balsamic-and-mozzarella-chicken", "question_idx": 640, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 6], "binary_question": "Must Step 7 happen after Step 4?", "why_question": "Why must Step 7 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 7 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 (placing mozzarella on the chicken) must happen after Step 4 (removing the chicken from the marinade) because the marinade would interfere with the mozzarella sticking to the chicken."}
{"plan_idx": 641, "title": "chocolate-pancake-batter", "question_idx": 641, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 8], "binary_question": "Must Step 9 happen after Step 3?", "why_question": "Why must Step 9 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 9 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 (flipping the pancake) must happen after Step 8 (cooking the first side for a minute)."}
{"plan_idx": 642, "title": "almond and apple cake", "question_idx": 642, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 13], "binary_question": "Must Step 14 happen after Step 13?", "why_question": "Why must Step 14 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 14 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 14 (serve warm) should happen after Step 13 (turning onto a serving plate) to ensure the cake is cool enough to handle before serving."}
{"plan_idx": 643, "title": "butternut-squash-pastry-for-pies", "question_idx": 643, "steps": ["Place the flour, egg and squash into the container of a food processor.", "Pulse until mixed into a doughy ball.", "You may need to add a little extra flour.", "Divide into two equal parts.", "Use in a pie or pastie recipe."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: butternut-squash-pastry-for-pies\n\nProcedure:\n1. Place the flour, egg and squash into the container of a food processor.\n2. Pulse until mixed into a doughy ball.\n3. You may need to add a little extra flour.\n4. Divide into two equal parts.\n5. Use in a pie or pastie recipe.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 2 must happen after Step 1 because the ingredients need to be placed in the food processor before they can be pulsed into a doughy ball."}
{"plan_idx": 644, "title": "almond and apple cake", "question_idx": 644, "steps": ["Preheat the oven to 170 C / Gas mark 3.", "Brush around 22cm (base measurement) cake tin with melted butter to grease.", "Line base and side with baking parchment.", "Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).", "Add the eggs, 1 at a time, beating well after each addition.", "Stir in ground almonds.", "Add half the flour and half the milk.", "Use a wooden spoon to stir until well combined.", "Repeat remaining flour and milk.", "Arrange the apple, slightly overlapping, over the base of the prepared tin.", "Spoon mixture into the tin and smooth the surface.", "Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.", "Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.", "Serve warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 13], "binary_question": "Must Step 14 happen after Step 2?", "why_question": "Why must Step 14 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almond and apple cake\n\nProcedure:\n1. Preheat the oven to 170 C / Gas mark 3.\n2. Brush around 22cm (base measurement) cake tin with melted butter to grease.\n3. Line base and side with baking parchment.\n4. Beat butter, caster sugar and vanilla in a bowl for 8 mins or till pale and creamy (by hand or electric beater).\n5. Add the eggs, 1 at a time, beating well after each addition.\n6. Stir in ground almonds.\n7. Add half the flour and half the milk.\n8. Use a wooden spoon to stir until well combined.\n9. Repeat remaining flour and milk.\n10. Arrange the apple, slightly overlapping, over the base of the prepared tin.\n11. Spoon mixture into the tin and smooth the surface.\n12. Bake in the oven for 30-35 mins or until a skewer inserted into the centre comes out clean.\n13. Set aside in the pan for 10 mins to cool slightly before turning onto a serving plate.\n14. Serve warm.\n\n\n1. Must Step 14 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Steps 3-13 must be completed before Step 14."}
{"plan_idx": 645, "title": "slow cooker butter chicken", "question_idx": 645, "steps": ["Heat the butter and vegetable oil in a large frying pan over medium heat.", "Stir in the chicken, onion and garlic.", "Cook and stir until the onion has softened and turned translucent, about 10 minutes.", "Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.", "Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.", "Season to taste with salt.", "Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.", "Remove and discard the cardamom pods before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: slow cooker butter chicken\n\nProcedure:\n1. Heat the butter and vegetable oil in a large frying pan over medium heat.\n2. Stir in the chicken, onion and garlic.\n3. Cook and stir until the onion has softened and turned translucent, about 10 minutes.\n4. Stir in the curry powder, curry paste, tandoori masala, garam masala and tomato puree until no lumps of tomato puree remain.\n5. Pour into a slow cooker, and stir in the cardamom pods, coconut milk and yoghurt.\n6. Season to taste with salt.\n7. Cook on High 4 to 6 hours, or on Low 6 to 8 hours until the chicken is tender and the sauce has reduced to your desired consistency.\n8. Remove and discard the cardamom pods before serving.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 can happen after any step because it only involves adding salt to taste."}
{"plan_idx": 646, "title": "fusilli-and-meatballs", "question_idx": 646, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [12, 17], "binary_question": "Must Step 18 happen after Step 13?", "why_question": "Why must Step 18 happen after Step 13?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 18 happen after Step 13?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Steps 18 and 13 can be done in any order."}
{"plan_idx": 647, "title": "fusilli-and-meatballs", "question_idx": 647, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 3], "binary_question": "Must Step 4 happen after Step 1?", "why_question": "Why must Step 4 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 4 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 (setting aside 2 tablespoons of the onion mixture) must happen after Step 1 (saut\u00e9ing the onion and garlic) because the onion mixture is created in Step 1."}
{"plan_idx": 648, "title": "chocolate-chocolate-cake", "question_idx": 648, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [13, 21], "binary_question": "Must Step 22 happen after Step 14?", "why_question": "Why must Step 22 happen after Step 14?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 22 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 22 does not have to happen after Step 14 because the cake needs to be baked and cooled before it can be decorated."}
{"plan_idx": 649, "title": "cranachan", "question_idx": 649, "steps": ["Preheat the oven to 180 C / Gas mark 4.", "Spread oats out in a thin layer on a baking tray.", "Toast in the oven for about 10 minutes, or until lightly browned.", "Set aside to cool.", "Remove them from the tray for faster cooling.", "In a medium bowl, whip the cream to firm peaks.", "Gently fold in the icing sugar, vanilla and toasted oats.", "Spoon into 4 serving bowls, and top with fresh berries.", "For an extra touch, drizzle some whisky over each serving.", "Garnish with a mint leaf."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cranachan\n\nProcedure:\n1. Preheat the oven to 180 C / Gas mark 4.\n2. Spread oats out in a thin layer on a baking tray.\n3. Toast in the oven for about 10 minutes, or until lightly browned.\n4. Set aside to cool.\n5. Remove them from the tray for faster cooling.\n6. In a medium bowl, whip the cream to firm peaks.\n7. Gently fold in the icing sugar, vanilla and toasted oats.\n8. Spoon into 4 serving bowls, and top with fresh berries.\n9. For an extra touch, drizzle some whisky over each serving.\n10. Garnish with a mint leaf.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 (spooning the mixture into serving bowls) does not rely on the cooling of the oats in Step 4."}
{"plan_idx": 650, "title": "vegetable-terrine", "question_idx": 650, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (arranging the vegetables) can happen after Step 5 (washing the sorrel) because the sorrel needs to be cooked before it is added to the cream mixture."}
{"plan_idx": 651, "title": "lightly spiced tomato and red lentil soup", "question_idx": 651, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 11], "binary_question": "Must Step 12 happen after Step 2?", "why_question": "Why must Step 12 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 12 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 can happen after any step in the procedure, as it simply refers to serving the soup."}
{"plan_idx": 652, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 652, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 6 divides the dough in half so that Step 7 can happen separately for each half of the dough."}
{"plan_idx": 653, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 653, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4, where the mushrooms are cooked until they give up their juices, must happen after Step 2, where the onions are softened, because the onions need to be cooked before the mushrooms can be added and cooked."}
{"plan_idx": 654, "title": "spiced butternut squash soup", "question_idx": 654, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [10, 16], "binary_question": "Must Step 17 happen after Step 11?", "why_question": "Why must Step 17 happen after Step 11?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 17 happen after Step 11?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 17 does not depend on the completion of Step 11, as it involves ladling the soup into bowls and topping it, which can be done after the soup has been heated through in Step 16."}
{"plan_idx": 655, "title": "chocolate-chocolate-cake", "question_idx": 655, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The chocolate mixture must cool before being added to the batter, otherwise it will cook the eggs."}
{"plan_idx": 656, "title": "halloumi-and-figs", "question_idx": 656, "steps": ["Preheat a grill for high heat.", "Break up the halloumi cheese, and toss with the fresh figs and walnuts in a small dish.", "Grill under the preheated grill until the halloumi is browned and the figs begin to caramelise, about 3 minutes.", "Drizzle with the honey."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: halloumi-and-figs\n\nProcedure:\n1. Preheat a grill for high heat.\n2. Break up the halloumi cheese, and toss with the fresh figs and walnuts in a small dish.\n3. Grill under the preheated grill until the halloumi is browned and the figs begin to caramelise, about 3 minutes.\n4. Drizzle with the honey.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 (drizzling with honey) must happen after Step 2 (tossing with figs and walnuts) because the honey would burn if it was added before grilling."}
{"plan_idx": 657, "title": "green-tofu-curry", "question_idx": 657, "steps": ["Place water in a medium saucepan, and stir in the rice.", "Bring to the boil.", "Cover, reduce heat, and simmer 20 minutes.", "Remove from heat, cool slightly, and fluff with a fork.", "Heat the sesame oil in a separate medium saucepan over medium heat.", "Stir in tofu.", "Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.", "Season with salt.", "In a small saucepan, bring the coconut milk to the boil.", "Mix in green curry paste.", "Reduce heat, and simmer 5 minutes.", "Drizzle generously over the tofu and rice to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 11], "binary_question": "Must Step 12 happen after Step 5?", "why_question": "Why must Step 12 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: green-tofu-curry\n\nProcedure:\n1. Place water in a medium saucepan, and stir in the rice.\n2. Bring to the boil.\n3. Cover, reduce heat, and simmer 20 minutes.\n4. Remove from heat, cool slightly, and fluff with a fork.\n5. Heat the sesame oil in a separate medium saucepan over medium heat.\n6. Stir in tofu.\n7. Stirring occasionally, fry about 20 minutes, until evenly crisp and lightly browned.\n8. Season with salt.\n9. In a small saucepan, bring the coconut milk to the boil.\n10. Mix in green curry paste.\n11. Reduce heat, and simmer 5 minutes.\n12. Drizzle generously over the tofu and rice to serve.\n\n\n1. Must Step 12 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 12 can happen at any time after Step 11 because there is no dependency on Step 5."}
{"plan_idx": 658, "title": "fusilli-and-meatballs", "question_idx": 658, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [11, 17], "binary_question": "Must Step 18 happen after Step 12?", "why_question": "Why must Step 18 happen after Step 12?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 18 happen after Step 12?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 18 involves cooking the meatballs in the tomato sauce, which requires the meatballs to have been made in Step 12."}
{"plan_idx": 659, "title": "chicken-prawn-and-rice-soup", "question_idx": 659, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 (bring to the boil) should happen after Step 5 (add mixture to soup pot) because the soup mixture needs to be in the pot before it can be brought to the boil."}
{"plan_idx": 660, "title": "chicken and vegetable pie", "question_idx": 660, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 12], "binary_question": "Must Step 13 happen after Step 8?", "why_question": "Why must Step 13 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 13 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 involves covering the pie with top pastry and sealing the edges, which must be done after the liquid mixture in Step 8 has been poured over the chicken mixture."}
{"plan_idx": 661, "title": "lamb-curry--serves-4-", "question_idx": 661, "steps": ["Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.", "Fry the lamb in a little oil, then add the remaining onion.", "Gently fry for a minute, then add the paste and cook for a couple of minutes.", "Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.", "Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lamb-curry--serves-4-\n\nProcedure:\n1. Blend the garlic, ginger and one of the onions in a food processor then mix with the curry paste.\n2. Fry the lamb in a little oil, then add the remaining onion.\n3. Gently fry for a minute, then add the paste and cook for a couple of minutes.\n4. Add the water, tin of tomatoes, sugar, mushrooms and potatoes, and gently simmer covered for a few hours, until everything is tender.\n5. Add the two fresh tomatoes and the spinach and cook for a couple of minutes, then serve.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 4 does not depend on Step 2 being completed, as the ingredients added in Step 4 do not require the lamb to be fried."}
{"plan_idx": 662, "title": "tomato and basil salad", "question_idx": 662, "steps": ["Grab an attractive serving plate; flat glass or black works nicely.", "Slice the tomatoes thinly and scatter onto plate.", "Sprinkle with salt, then scatter all over the basil leaves.", "Drizzle over the vinegar and oil.", "Cover with cling film and leave at room temperature until ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 4], "binary_question": "Must Step 5 happen after Step 2?", "why_question": "Why must Step 5 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tomato and basil salad\n\nProcedure:\n1. Grab an attractive serving plate; flat glass or black works nicely.\n2. Slice the tomatoes thinly and scatter onto plate.\n3. Sprinkle with salt, then scatter all over the basil leaves.\n4. Drizzle over the vinegar and oil.\n5. Cover with cling film and leave at room temperature until ready to serve.\n\n\n1. Must Step 5 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 3 and Step 4 can be performed before Step 5."}
{"plan_idx": 663, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 663, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 8 (grilling the spinach rolls) should happen after Step 6 (brushing with olive oil) to ensure that the oil does not burn when grilled."}
{"plan_idx": 664, "title": "lightly spiced tomato and red lentil soup", "question_idx": 664, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 10], "binary_question": "Must Step 11 happen after Step 4?", "why_question": "Why must Step 11 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 11 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (season to taste) should happen after Step 10 (check the consistency)."}
{"plan_idx": 665, "title": "chocolate-chocolate-cake", "question_idx": 665, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 15], "binary_question": "Must Step 16 happen after Step 7?", "why_question": "Why must Step 16 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 16 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 16 involves pouring the mixture into the cake tin, which requires the mixture to be prepared first, as outlined in the preceding steps."}
{"plan_idx": 666, "title": "chicken and vegetable pie", "question_idx": 666, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 12], "binary_question": "Must Step 13 happen after Step 9?", "why_question": "Why must Step 13 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 13 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 13 involves covering the pie dish with top pastry, which must be done after the hot liquid mixture is poured into the dish (Step 12)."}
{"plan_idx": 667, "title": "chicken and vegetable pie", "question_idx": 667, "steps": ["Preheat oven to 220 C / Gas mark 7.", "In a saucepan, combine chicken, carrots, peas and celery.", "Add water to cover and boil for 15 minutes.", "Remove from heat, drain and set aside.", "In the saucepan over medium heat, cook onion in butter until soft and translucent.", "Stir in flour, salt, pepper and celery seed.", "Slowly stir in chicken stock and milk.", "Simmer over medium-low heat until thick.", "Remove from heat and set aside.", "Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.", "Place the chicken mixture in bottom of the prepared pie dish.", "Pour hot liquid mixture over.", "Cover with top pastry, seal edges, and cut away excess pastry.", "Make several small slits in the top to allow steam to escape.", "Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.", "Cool for 10 minutes before serving."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 14], "binary_question": "Must Step 15 happen after Step 8?", "why_question": "Why must Step 15 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken and vegetable pie\n\nProcedure:\n1. Preheat oven to 220 C / Gas mark 7.\n2. In a saucepan, combine chicken, carrots, peas and celery.\n3. Add water to cover and boil for 15 minutes.\n4. Remove from heat, drain and set aside.\n5. In the saucepan over medium heat, cook onion in butter until soft and translucent.\n6. Stir in flour, salt, pepper and celery seed.\n7. Slowly stir in chicken stock and milk.\n8. Simmer over medium-low heat until thick.\n9. Remove from heat and set aside.\n10. Prepare a 23cm (9 in) pie dish by lining with pastry, reserving pastry to cover.\n11. Place the chicken mixture in bottom of the prepared pie dish.\n12. Pour hot liquid mixture over.\n13. Cover with top pastry, seal edges, and cut away excess pastry.\n14. Make several small slits in the top to allow steam to escape.\n15. Bake in the preheated oven for 30 to 35 minutes, or until pastry is golden brown and filling is bubbly.\n16. Cool for 10 minutes before serving.\n\n\n1. Must Step 15 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 15 involves baking the pie, which requires the liquid mixture to have been simmered until thick in Step 8."}
{"plan_idx": 668, "title": "no-sugar-rock-cakes", "question_idx": 668, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 must happen after Step 3 because the ingredients mixed in Step 3 are used in Step 5."}
{"plan_idx": 669, "title": "white bread", "question_idx": 669, "steps": ["In a large bowl, dissolve the sugar in warm water, and then stir in yeast.", "Allow to proof until yeast resembles a creamy foam.", "Mix salt and oil into the yeast mixture.", "Mix in flour about 125g at a time.", "Knead dough on a lightly floured surface until smooth.", "Place in a well oiled bowl, and turn dough to coat.", "Cover with a damp cloth.", "Allow to rise until doubled in bulk, about 1 hour.", "Punch dough down.", "Knead for a few minutes, and divide in half.", "Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.", "Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.", "Bake in a preheated 180 C / Gas 4 oven for 30 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: white bread\n\nProcedure:\n1. In a large bowl, dissolve the sugar in warm water, and then stir in yeast.\n2. Allow to proof until yeast resembles a creamy foam.\n3. Mix salt and oil into the yeast mixture.\n4. Mix in flour about 125g at a time.\n5. Knead dough on a lightly floured surface until smooth.\n6. Place in a well oiled bowl, and turn dough to coat.\n7. Cover with a damp cloth.\n8. Allow to rise until doubled in bulk, about 1 hour.\n9. Punch dough down.\n10. Knead for a few minutes, and divide in half.\n11. Shape into loaves, and place into two well oiled 23x13cm (9x5 in) loaf tins.\n12. Allow to rise for 30 minutes, or until dough has risen 2.5cm (1 in) above tins.\n13. Bake in a preheated 180 C / Gas 4 oven for 30 minutes.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 (punch dough down) occurs after Step 8 (dough has doubled in bulk), not Step 2 (yeast resembles a creamy foam)."}
{"plan_idx": 670, "title": "chocolate-pancake-batter", "question_idx": 670, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 7], "binary_question": "Must Step 8 happen after Step 4?", "why_question": "Why must Step 8 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 8 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 (Cooking for a minute or so until the pancake edges start to crisp up) should happen after Step 7 (pouring the batter into the pan)."}
{"plan_idx": 671, "title": "easy strawberry tart", "question_idx": 671, "steps": ["Mix together the sugar, water, jam and cornflour in a medium large saucepan.", "Boil for one minute.", "Remove from heat.", "Stir in the sliced strawberries, and toss until well coated.", "Pour into the digestive biscuit base.", "Chill until well set.", "Serve topped with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 5], "binary_question": "Must Step 6 happen after Step 4?", "why_question": "Why must Step 6 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: easy strawberry tart\n\nProcedure:\n1. Mix together the sugar, water, jam and cornflour in a medium large saucepan.\n2. Boil for one minute.\n3. Remove from heat.\n4. Stir in the sliced strawberries, and toss until well coated.\n5. Pour into the digestive biscuit base.\n6. Chill until well set.\n7. Serve topped with whipped cream.\n\n\n1. Must Step 6 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The strawberries must be boiled and coated in the mixture before being added to the biscuit base."}
{"plan_idx": 672, "title": "one-pot irish stew", "question_idx": 672, "steps": ["Place the lamb in a large pot, cover with water and add a pinch of salt.", "Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.", "Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.", "Add the remaining potatoes and carrots.", "Simmer for another 20-30 minutes until potatoes are cooked.", "Season well with salt and pepper to taste.", "Stir in fresh parsley or chopped leeks.", "Serve piping hot."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: one-pot irish stew\n\nProcedure:\n1. Place the lamb in a large pot, cover with water and add a pinch of salt.\n2. Bring to the boil; skim off any white fat that comes to the surface, then simmer on low heat for another 30 minutes.\n3. Add the onion and half of the potatoes and cook for 30 minutes until the potatoes are soft; break them up and stir - this will thicken the stew.\n4. Add the remaining potatoes and carrots.\n5. Simmer for another 20-30 minutes until potatoes are cooked.\n6. Season well with salt and pepper to taste.\n7. Stir in fresh parsley or chopped leeks.\n8. Serve piping hot.\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 5 can happen before Step 3 because the order of adding potatoes and carrots is not crucial to the stew."}
{"plan_idx": 673, "title": "chocolate-chocolate-cake", "question_idx": 673, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 19], "binary_question": "Must Step 20 happen after Step 5?", "why_question": "Why must Step 20 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 20 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 20 does not need to happen after Step 5 because it is possible to cool the chocolate mixture in a separate bowl before adding it to the batter in Step 10."}
{"plan_idx": 674, "title": "spiced-pumpkin-teabread", "question_idx": 674, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 13], "binary_question": "Must Step 14 happen after Step 4?", "why_question": "Why must Step 14 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 14 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 14 can happen after any step in the procedure as it is not dependent on any specific previous step."}
{"plan_idx": 675, "title": "chocolate-pancake-batter", "question_idx": 675, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 does not have to happen after Step 3, as the instructions for making the chocolate-pancake-batter do not specify any order between these steps."}
{"plan_idx": 676, "title": "chicken-prawn-and-rice-soup", "question_idx": 676, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 6], "binary_question": "Must Step 7 happen after Step 6?", "why_question": "Why must Step 7 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 7 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 7 must happen after Step 6 because you cannot add salt and sherry to the mixture until it has been brought to the boil."}
{"plan_idx": 677, "title": "no-sugar-rock-cakes", "question_idx": 677, "steps": ["Preheat oven to 200 C / Gas 6.", "Line a baking tray with baking parchment.", "Mix flour, Splenda&reg;", "and butter in a bowl until a fine crumble is achieved.", "Add the egg and currants, and mix into a dough.", "Place balls of dough (slightly bigger than a golf ball) onto the baking tray;", "remember to space them out.", "Bake for 20 minutes, or till a nice golden brown.", "Remove and place on cooling tray."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 8], "binary_question": "Must Step 9 happen after Step 2?", "why_question": "Why must Step 9 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: no-sugar-rock-cakes\n\nProcedure:\n1. Preheat oven to 200 C / Gas 6.\n2. Line a baking tray with baking parchment.\n3. Mix flour, Splenda&reg;\n4. and butter in a bowl until a fine crumble is achieved.\n5. Add the egg and currants, and mix into a dough.\n6. Place balls of dough (slightly bigger than a golf ball) onto the baking tray;\n7. remember to space them out.\n8. Bake for 20 minutes, or till a nice golden brown.\n9. Remove and place on cooling tray.\n\n\n1. Must Step 9 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 can happen after any step in the procedure, as it is not dependent on the outcome of any other step."}
{"plan_idx": 678, "title": "shellabina-s-corned-beef-hash", "question_idx": 678, "steps": ["Add potatoes, carrots and onion to a large pan and add water to cover.", "Bring to boil and simmer for 20 minutes.", "Add corned beef and simmer for another 5 minutes.", "Add gravy granules and stir.", "The stew will now thicken up.", "It is now ready to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 5], "binary_question": "Must Step 6 happen after Step 1?", "why_question": "Why must Step 6 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: shellabina-s-corned-beef-hash\n\nProcedure:\n1. Add potatoes, carrots and onion to a large pan and add water to cover.\n2. Bring to boil and simmer for 20 minutes.\n3. Add corned beef and simmer for another 5 minutes.\n4. Add gravy granules and stir.\n5. The stew will now thicken up.\n6. It is now ready to serve.\n\n\n1. Must Step 6 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 6 does not have to happen after Step 1 because it is the final step in the procedure and can be done after all other steps have been completed."}
{"plan_idx": 679, "title": "chocolate-pancake-batter", "question_idx": 679, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 10], "binary_question": "Must Step 11 happen after Step 2?", "why_question": "Why must Step 11 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 11 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 does not depend on Step 2 happening first."}
{"plan_idx": 680, "title": "fusilli-and-meatballs", "question_idx": 680, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 3], "binary_question": "Must Step 4 happen after Step 2?", "why_question": "Why must Step 4 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 4 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The onion mixture must be transferred to a bowl to make room for the tomatoes in the saucepan."}
{"plan_idx": 681, "title": "brown sugar shortbread", "question_idx": 681, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 9], "binary_question": "Must Step 10 happen after Step 3?", "why_question": "Why must Step 10 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 10 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 is baking the shortbread in the oven, which is the final step in the procedure; it does not need to happen after Step 3."}
{"plan_idx": 682, "title": "tortellini-fritto-with-almond-butter", "question_idx": 682, "steps": ["Bring a saucepan of water to the boil.", "Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.", "In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.", "If you slightly undercooked your tortellini then it's less likely to stick to the pan.", "Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.", "Continue to gently fry and stir the tortellini until golden brown.", "Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.", "Enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 4], "binary_question": "Must Step 5 happen after Step 3?", "why_question": "Why must Step 5 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: tortellini-fritto-with-almond-butter\n\nProcedure:\n1. Bring a saucepan of water to the boil.\n2. Add the tortellini and cook according to the instructions on the packet, however I recommend you slightly under cook it and drain.\n3. In a non-stick shallow pan, heat some olive oil and gently fry the tortellini.\n4. If you slightly undercooked your tortellini then it's less likely to stick to the pan.\n5. Add some honey, salt to taste and around 2 tablespoons of the almond butter to the pan.\n6. Continue to gently fry and stir the tortellini until golden brown.\n7. Serve the tortellini with a drizzle of olive oil, freshly grated Parmesan cheese and green leaf salad of your choice.\n8. Enjoy!\n\n\n1. Must Step 5 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 5 must happen after Step 3 because the tortellini needs to be fried before honey, salt, and almond butter can be added."}
{"plan_idx": 683, "title": "balsamic-and-mozzarella-chicken", "question_idx": 683, "steps": ["Place chicken in a shallow dish or large resealable plastic bag.", "Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.", "Coat a large frying pan lightly with oil, and set over low heat.", "Remove the chicken from the marinade and discard the marinade.", "Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.", "Arrange chicken on a serving platter.", "Place a generous slice of fresh mozzarella on top of each piece.", "Place a leaf of basil on top of the cheese, and cover with a slice of tomato.", "Drizzle balsamic vinegar over the platter, then season with salt and pepper.", "Serve!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 9], "binary_question": "Must Step 10 happen after Step 7?", "why_question": "Why must Step 10 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: balsamic-and-mozzarella-chicken\n\nProcedure:\n1. Place chicken in a shallow dish or large resealable plastic bag.\n2. Pour the vinaigrette over it, cover or seal and marinate in the fridge for 12 to 24 hours.\n3. Coat a large frying pan lightly with oil, and set over low heat.\n4. Remove the chicken from the marinade and discard the marinade.\n5. Saute chicken breast fillets over low heat for about 30 minutes, or until juices run clear.\n6. Arrange chicken on a serving platter.\n7. Place a generous slice of fresh mozzarella on top of each piece.\n8. Place a leaf of basil on top of the cheese, and cover with a slice of tomato.\n9. Drizzle balsamic vinegar over the platter, then season with salt and pepper.\n10. Serve!\n\n\n1. Must Step 10 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 (serve) does not have to happen after Step 7 (place a mozzarella slice on each chicken piece) because the subsequent steps involve adding basil and tomato, and drizzling with balsamic vinegar."}
{"plan_idx": 684, "title": "peppers-with-tuna-and-mushrooms", "question_idx": 684, "steps": ["Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.", "Cook for 5 minutes or until softened.", "Add 250g halved or quartered chestnut mushrooms.", "Season and cook, stirring occasionally, until the mushrooms give up their juices.", "Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.", "Cook, stirring until the mushrooms are evenly coated with a little sauce.", "Meanwhile, drain and slice a 280g jar of roasted red peppers.", "Mix the peppers into the mushrooms and heat gently for 1 minute.", "Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.", "Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 9], "binary_question": "Must Step 10 happen after Step 5?", "why_question": "Why must Step 10 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: peppers-with-tuna-and-mushrooms\n\nProcedure:\n1. Heat 2 tbsp olive oil in a frying pan and add 1 chopped onion.\n2. Cook for 5 minutes or until softened.\n3. Add 250g halved or quartered chestnut mushrooms.\n4. Season and cook, stirring occasionally, until the mushrooms give up their juices.\n5. Add 1 tbsp wholegrain mustard, the grated zest of 1 lemon, 1 crushed garlic clove and 4 tbsp dry sherry.\n6. Cook, stirring until the mushrooms are evenly coated with a little sauce.\n7. Meanwhile, drain and slice a 280g jar of roasted red peppers.\n8. Mix the peppers into the mushrooms and heat gently for 1 minute.\n9. Finally, stir in a 185g can tuna, drained, and 25g chopped fresh parsley.\n10. Serve immediately, with crisp salad leaves and plenty of hot crusty bread or boiled rice.\n\n\n1. Must Step 10 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not depend on Step 5 and can be done after any step."}
{"plan_idx": 685, "title": "chocolate-pancake-batter", "question_idx": 685, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 7], "binary_question": "Must Step 8 happen after Step 3?", "why_question": "Why must Step 8 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 8 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 (cooking the pancake) cannot happen after Step 3 (whisking in the milk, melted butter, and sugar) because the batter is not yet complete and needs to be in the pan to cook."}
{"plan_idx": 686, "title": "chocolate-pancake-batter", "question_idx": 686, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 8], "binary_question": "Must Step 9 happen after Step 8?", "why_question": "Why must Step 9 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 9 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: In order to cook both sides of the pancake, Step 9 (flipping the pancake) must happen after Step 8 (cooking the first side)."}
{"plan_idx": 687, "title": "chocolate-pancake-batter", "question_idx": 687, "steps": ["Sift the flour and cocoa powder into a bowl.", "Make a well in the centre and whisk in the beaten eggs.", "Gradually whisk in milk, melted butter and sugar.", "For best results, set the pancake batter aside for 20 minutes to rest.", "Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.", "Use a piece of kitchen paper to grease the pan with a little sunflower oil.", "Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.", "Cook for a minute or so until the pancake edges start to crisp up.", "Use a palette knife to flip the pancake and cook the other side, about 1 minute.", "Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.", "Stack the pancakes on top of each other to keep warm."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 6], "binary_question": "Must Step 7 happen after Step 5?", "why_question": "Why must Step 7 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-pancake-batter\n\nProcedure:\n1. Sift the flour and cocoa powder into a bowl.\n2. Make a well in the centre and whisk in the beaten eggs.\n3. Gradually whisk in milk, melted butter and sugar.\n4. For best results, set the pancake batter aside for 20 minutes to rest.\n5. Heat a heavy-based non-stick frying pan (about 20-22cm in diameter) over moderate heat.\n6. Use a piece of kitchen paper to grease the pan with a little sunflower oil.\n7. Use a soup ladle to pour some batter into the middle of the pan, just enough to create a slightly thicker pancake than a crepe.\n8. Cook for a minute or so until the pancake edges start to crisp up.\n9. Use a palette knife to flip the pancake and cook the other side, about 1 minute.\n10. Turn out of the pan and repeat with remaining batter, greasing the pan between pancakes if necessary.\n11. Stack the pancakes on top of each other to keep warm.\n\n\n1. Must Step 7 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The batter needs to be heated, which is done in step 5."}
{"plan_idx": 688, "title": "fusilli-and-meatballs", "question_idx": 688, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 1], "binary_question": "Must Step 2 happen after Step 1?", "why_question": "Why must Step 2 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 2 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 2 must happen after Step 1 because the onion mixture used in Step 3 is created in Step 2."}
{"plan_idx": 689, "title": "vegetable-terrine", "question_idx": 689, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [13, 14], "binary_question": "Must Step 15 happen after Step 14?", "why_question": "Why must Step 15 happen after Step 14?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 15 happen after Step 14?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 15 requires the terrine to be refrigerated for several hours, which means that it must happen after the terrine is made."}
{"plan_idx": 690, "title": "chicken-prawn-and-rice-soup", "question_idx": 690, "steps": ["Mix together the prawns, chicken, egg and cornflour.", "Heat 750ml of the oil in wok or deep frying pan.", "When it is hot, add prawns and chicken mixture.", "Cook for 1/2 minute and drain.", "Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.", "Bring to the boil.", "Add salt and sherry.", "Return to the boil.", "Reduce heat and allow to simmer.", "Meanwhile, heat the remaining 250ml oil until it is hot.", "Add rice and brown quickly.", "Drain and add to soup.", "Serve and enjoy!"], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 7], "binary_question": "Must Step 8 happen after Step 2?", "why_question": "Why must Step 8 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chicken-prawn-and-rice-soup\n\nProcedure:\n1. Mix together the prawns, chicken, egg and cornflour.\n2. Heat 750ml of the oil in wok or deep frying pan.\n3. When it is hot, add prawns and chicken mixture.\n4. Cook for 1/2 minute and drain.\n5. Place above mixture in pot with the stock, mushrooms, water chestnuts, bamboo shoots and green beans.\n6. Bring to the boil.\n7. Add salt and sherry.\n8. Return to the boil.\n9. Reduce heat and allow to simmer.\n10. Meanwhile, heat the remaining 250ml oil until it is hot.\n11. Add rice and brown quickly.\n12. Drain and add to soup.\n13. Serve and enjoy!\n\n\n1. Must Step 8 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 8 does not have to happen after Step 2 as the instructions don't require it."}
{"plan_idx": 691, "title": "vegetable-terrine", "question_idx": 691, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [4, 14], "binary_question": "Must Step 15 happen after Step 5?", "why_question": "Why must Step 15 happen after Step 5?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 15 happen after Step 5?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 15 can happen after any step in the procedure as it is the final step of serving the terrine."}
{"plan_idx": 692, "title": "banana-split-cake", "question_idx": 692, "steps": ["Preheat oven to 190 C / Gas 5.", "In a large bowl, combine flour, 175g margarine and chopped pecans.", "Press into the bottom of a 20x30cm tin.", "Bake in preheated oven for 20 minutes.", "Remove from oven and allow to cool.", "In a large bowl, combine remaining margarine, eggs and icing sugar.", "Beat with an electric mixer for 6 minutes or until fluffy.", "Spread over cooled base.", "Slice bananas and arrange on filling, then top with pineapple.", "Slice strawberries and layer over bananas.", "Cover with whipped cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [0, 10], "binary_question": "Must Step 11 happen after Step 1?", "why_question": "Why must Step 11 happen after Step 1?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: banana-split-cake\n\nProcedure:\n1. Preheat oven to 190 C / Gas 5.\n2. In a large bowl, combine flour, 175g margarine and chopped pecans.\n3. Press into the bottom of a 20x30cm tin.\n4. Bake in preheated oven for 20 minutes.\n5. Remove from oven and allow to cool.\n6. In a large bowl, combine remaining margarine, eggs and icing sugar.\n7. Beat with an electric mixer for 6 minutes or until fluffy.\n8. Spread over cooled base.\n9. Slice bananas and arrange on filling, then top with pineapple.\n10. Slice strawberries and layer over bananas.\n11. Cover with whipped cream.\n\n\n1. Must Step 11 happen after Step 1?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11, covering with whipped cream, should happen after Steps 9 and 10, which involve slicing and layering the bananas, pineapple, and strawberries."}
{"plan_idx": 693, "title": "chocolate-chocolate-cake", "question_idx": 693, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 9], "binary_question": "Must Step 10 happen after Step 6?", "why_question": "Why must Step 10 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 10 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: This step must happen after Step 6 because the chocolate mixture needs to be cooled before it can be added to the butter and margarine mixture."}
{"plan_idx": 694, "title": "chocolate-chocolate-cake", "question_idx": 694, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 20], "binary_question": "Must Step 21 happen after Step 9?", "why_question": "Why must Step 21 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 21 involves cooling the cake after baking, which happens after Step 17, not Step 9."}
{"plan_idx": 695, "title": "cloud-bread", "question_idx": 695, "steps": ["Preheat oven to 150 C / Gas mark 2.", "Line a baking tray with baking paper.", "Mix cream cheese and egg yolks together until smooth.", "Place egg whites and baking powder in a glass, metal, or ceramic bowl;", "beat together until stiff peaks form.", "Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.", "Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.", "Bake in the preheated oven until golden brown, 17 to 20 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 4], "binary_question": "Must Step 5 happen after Step 4?", "why_question": "Why must Step 5 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: cloud-bread\n\nProcedure:\n1. Preheat oven to 150 C / Gas mark 2.\n2. Line a baking tray with baking paper.\n3. Mix cream cheese and egg yolks together until smooth.\n4. Place egg whites and baking powder in a glass, metal, or ceramic bowl;\n5. beat together until stiff peaks form.\n6. Fold cream cheese and egg yolk mixture gently into egg whites until just combined and light yellow in colour.\n7. Spoon the batter onto the prepared baking tray in mounds about 10cm in diameter, flattening peaks with the back of the spoon.\n8. Bake in the preheated oven until golden brown, 17 to 20 minutes.\n\n\n1. Must Step 5 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: In order to achieve stiff peaks, the egg whites need to be separated from the egg yolks, which is done in Step 4."}
{"plan_idx": 696, "title": "chocolate-chocolate-cake", "question_idx": 696, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [3, 20], "binary_question": "Must Step 21 happen after Step 4?", "why_question": "Why must Step 21 happen after Step 4?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 21 happen after Step 4?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, because Step 21 involves cooling the cake after it has been baked, while Step 4 involves cooling the chocolate mixture before adding it to the cake mix."}
{"plan_idx": 697, "title": "lightly spiced tomato and red lentil soup", "question_idx": 697, "steps": ["Heat the oil in a saucepan.", "Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.", "Stir in the celery and carrot and cook for 3 minutes, stirring frequently.", "Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.", "Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.", "Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.", "Meanwhile, stir the coriander into the yoghurt for the garnish.", "Remove the bay leaf from the soup.", "Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.", "Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.", "Season to taste, then reheat until just bubbling.", "Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [7, 9], "binary_question": "Must Step 10 happen after Step 8?", "why_question": "Why must Step 10 happen after Step 8?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lightly spiced tomato and red lentil soup\n\nProcedure:\n1. Heat the oil in a saucepan.\n2. Add the onion and cook over a low heat for 7-8 minutes, stirring occasionally, until beginning to soften.\n3. Stir in the celery and carrot and cook for 3 minutes, stirring frequently.\n4. Add the garlic, cumin and coriander and cook for a further minute, stirring constantly.\n5. Add the lentils, stock, tomatoes with their juice, tomato pur\u00c3\u00a9e and bay leaf.\n6. Bring to the boil, reduce the heat, then half-cover the pan with a lid and simmer for 25-30 minutes until the lentils and vegetables are very soft.\n7. Meanwhile, stir the coriander into the yoghurt for the garnish.\n8. Remove the bay leaf from the soup.\n9. Blend the soup in the pan using a hand-held blender, or tip into a blender or food processor, process until smooth, then return the soup to the pan.\n10. Check the consistency; it will be fairly thick, so if you prefer it thinner, dilute with a little more stock.\n11. Season to taste, then reheat until just bubbling.\n12. Serve drizzled with some of the coriander yoghurt and sprinkled with freshly ground black pepper.\n\n\n1. Must Step 10 happen after Step 8?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 10 does not have to happen after Step 8 because it is not dependent on the removal of the bay leaf."}
{"plan_idx": 698, "title": "brown sugar shortbread", "question_idx": 698, "steps": ["Preheat oven to 160 C / Gas mark 3.", "Cream butter and brown sugar.", "Add 400g to 500g flour.", "Mix well.", "Sprinkle board with the remaining flour.", "Knead for 5 minutes, adding enough flour to make a soft dough.", "Roll to 1cm (1/2 in) thickness.", "Cut into 7x2cm (3x1 in) strips.", "Prick with fork and place on ungreased baking trays.", "Bake in preheated oven for 20 to 25 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 7], "binary_question": "Must Step 8 happen after Step 6?", "why_question": "Why must Step 8 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: brown sugar shortbread\n\nProcedure:\n1. Preheat oven to 160 C / Gas mark 3.\n2. Cream butter and brown sugar.\n3. Add 400g to 500g flour.\n4. Mix well.\n5. Sprinkle board with the remaining flour.\n6. Knead for 5 minutes, adding enough flour to make a soft dough.\n7. Roll to 1cm (1/2 in) thickness.\n8. Cut into 7x2cm (3x1 in) strips.\n9. Prick with fork and place on ungreased baking trays.\n10. Bake in preheated oven for 20 to 25 minutes.\n\n\n1. Must Step 8 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Cutting the dough into strips must happen after the dough has been kneaded and before it is rolled and baked."}
{"plan_idx": 699, "title": "vegetable-terrine", "question_idx": 699, "steps": ["Add the gelatin in a bowl of cold water until soft.", "Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).", "Run the vegetables under cold water to stop them cooking.", "Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.", "In a saucepan, bring cream and yogurt to the boil.", "Add the chopped sorrel and gelatin.", "Mix well and remove from heat.", "Set aside and cool for a few minutes.", "Pour approximately 1cm of the cream mixture into a mould and refrigerate.", "It is better to use a silicone mould, it will be easier to remove for serving.", "Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.", "Pour the remaining cream mixture on top.", "Refrigerate the terrine for several hours until firm.", "If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.", "Serve chilled."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 14], "binary_question": "Must Step 15 happen after Step 2?", "why_question": "Why must Step 15 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: vegetable-terrine\n\nProcedure:\n1. Add the gelatin in a bowl of cold water until soft.\n2. Heat the stock and cook the vegetables one after the other in the stock (15 minutes for the carrots and beans, 10 minutes for courgettes and celeriac, 5 minutes for the peas).\n3. Run the vegetables under cold water to stop them cooking.\n4. Wash the sorrel, add the olive oil to a frying pan and cook for 3 minutes, chop then set aside.\n5. In a saucepan, bring cream and yogurt to the boil.\n6. Add the chopped sorrel and gelatin.\n7. Mix well and remove from heat.\n8. Set aside and cool for a few minutes.\n9. Pour approximately 1cm of the cream mixture into a mould and refrigerate.\n10. It is better to use a silicone mould, it will be easier to remove for serving.\n11. Arrange the vegetables, alternating according to shape, starting with the matchstick vegetables on the bottom and peas in the middle.\n12. Pour the remaining cream mixture on top.\n13. Refrigerate the terrine for several hours until firm.\n14. If you did'nt use a silicone mould, immerse the mould in boiling water then turn it over - it should release.\n15. Serve chilled.\n\n\n1. Must Step 15 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, Step 15 can happen after Step 14, but it does not have to."}
{"plan_idx": 700, "title": "spiced butternut squash soup", "question_idx": 700, "steps": ["Preheat the oven to 190 C / Gas mark 6.", "Pour a small layer of water in a baking dish, or a swiss roll tin.", "Place the squash halves cut side down on the dish.", "Bake for about 40 minutes, or until a fork can easily pierce the flesh.", "Cool slightly, then remove the peel.", "Set aside.", "Melt the butter in a large pot over medium heat.", "Add the onion, leek and garlic, and saute for a few minutes, until tender.", "Pour the chicken stock into the pot.", "Add the potatoes, and bring to the boil.", "Cook for about 20 minutes, or until soft.", "Add the squash, and mash with the potatoes until chunks are small.", "Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.", "Return to the pot.", "Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.", "Heat through, but do not boil.", "Ladle into bowls, and top with a dollop of soured cream if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [6, 10], "binary_question": "Must Step 11 happen after Step 7?", "why_question": "Why must Step 11 happen after Step 7?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced butternut squash soup\n\nProcedure:\n1. Preheat the oven to 190 C / Gas mark 6.\n2. Pour a small layer of water in a baking dish, or a swiss roll tin.\n3. Place the squash halves cut side down on the dish.\n4. Bake for about 40 minutes, or until a fork can easily pierce the flesh.\n5. Cool slightly, then remove the peel.\n6. Set aside.\n7. Melt the butter in a large pot over medium heat.\n8. Add the onion, leek and garlic, and saute for a few minutes, until tender.\n9. Pour the chicken stock into the pot.\n10. Add the potatoes, and bring to the boil.\n11. Cook for about 20 minutes, or until soft.\n12. Add the squash, and mash with the potatoes until chunks are small.\n13. Use an immersion hand blender to puree the soup, or transfer to a blender or food processor in batches, and puree until smooth.\n14. Return to the pot.\n15. Season the soup with cayenne pepper, allspice, nutmeg, ginger, salt and pepper, then stir in the sherry, cream and milk.\n16. Heat through, but do not boil.\n17. Ladle into bowls, and top with a dollop of soured cream if desired.\n\n\n1. Must Step 11 happen after Step 7?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 11 (cooking the potatoes) should happen after Step 7 (melting the butter) because the potatoes are added to the melted butter in Step 10."}
{"plan_idx": 701, "title": "strawberries-in-pimm-s", "question_idx": 701, "steps": ["Place the strawberries in a large bowl.", "Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.", "Let stand at room temperature for 15 minutes, stirring occasionally.", "Add the Pimm's, and stir once more.", "Let stand for another 30 minutes at room temperature.", "Garnish with mint leaves, if desired."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 5], "binary_question": "Must Step 6 happen after Step 3?", "why_question": "Why must Step 6 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: strawberries-in-pimm-s\n\nProcedure:\n1. Place the strawberries in a large bowl.\n2. Sprinkle the sugar evenly over the strawberries, and stir to evenly coat all of the fruit.\n3. Let stand at room temperature for 15 minutes, stirring occasionally.\n4. Add the Pimm's, and stir once more.\n5. Let stand for another 30 minutes at room temperature.\n6. Garnish with mint leaves, if desired.\n\n\n1. Must Step 6 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: No, the sequence between Step 3 and Step 6 is not specified."}
{"plan_idx": 702, "title": "almost no fat banana bread", "question_idx": 702, "steps": ["Preheat oven to 180 C / Gas mark 4.", "Lightly grease a 20x10cm (8x4 in) loaf tin.", "In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.", "Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.", "Pour batter into prepared tin.", "Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.", "Turn out onto wire rack and allow to cool before slicing."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 3], "binary_question": "Must Step 4 happen after Step 3?", "why_question": "Why must Step 4 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: almost no fat banana bread\n\nProcedure:\n1. Preheat oven to 180 C / Gas mark 4.\n2. Lightly grease a 20x10cm (8x4 in) loaf tin.\n3. In a large bowl, stir together flour, sugar, baking powder, bicarbonate of soda and cinnamon.\n4. Add egg whites, bananas and apple pur\u00c3\u00a9e; stir just until combined.\n5. Pour batter into prepared tin.\n6. Bake in preheated oven for 50 to 55 minutes, until a skewer inserted into centre of loaf comes out clean.\n7. Turn out onto wire rack and allow to cool before slicing.\n\n\n1. Must Step 4 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 4 involves adding egg whites, bananas and apple puree to the dry ingredients, which have been combined in Step 3. These wet ingredients need to be mixed with the dry ingredients to form the batter."}
{"plan_idx": 703, "title": "curried bbq mussels", "question_idx": 703, "steps": ["Preheat barbecue for medium-high heat and lightly oil the cooking grate.", "Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.", "Arrange four large sheets of foil on a flat surface.", "Divide the mussels into four even portions and place one portion on each piece of foil.", "Dot the mussels with the curry mixture.", "Sprinkle the red pepper and parsley over the top of each portion.", "Top each with lime slices.", "Wrap foil tightly around the portions.", "Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.", "Discard any mussels which do not open.", "Transfer the mussels to small bowls and garnish each with a lime wedge to serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [2, 10], "binary_question": "Must Step 11 happen after Step 3?", "why_question": "Why must Step 11 happen after Step 3?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: curried bbq mussels\n\nProcedure:\n1. Preheat barbecue for medium-high heat and lightly oil the cooking grate.\n2. Whisk together the butter, garlic, curry powder, cumin and salt in a small bowl.\n3. Arrange four large sheets of foil on a flat surface.\n4. Divide the mussels into four even portions and place one portion on each piece of foil.\n5. Dot the mussels with the curry mixture.\n6. Sprinkle the red pepper and parsley over the top of each portion.\n7. Top each with lime slices.\n8. Wrap foil tightly around the portions.\n9. Cook the packets on the preheated barbecue until the mussels have opened, 5 to 10 minutes.\n10. Discard any mussels which do not open.\n11. Transfer the mussels to small bowls and garnish each with a lime wedge to serve.\n\n\n1. Must Step 11 happen after Step 3?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 11 (garnishing) does not require Step 3 (putting foil on a flat surface) to have already happened."}
{"plan_idx": 704, "title": "spiced-pumpkin-teabread", "question_idx": 704, "steps": ["Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).", "Line a 900 g (2 lb) loaf tin with baking parchment.", "Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.", "Drain thoroughly, then mash with a potato masher until smooth.", "Add the honey and sultanas, and beat well.", "Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.", "Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.", "Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.", "Tip the mixture into the prepared tin and smooth the surface.", "Sprinkle with the pumpkin seeds.", "Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.", "Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.", "Gently brush with the 2 tsp honey while still warm.", "This teabread is best served slightly warm, or within a day of making."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [8, 11], "binary_question": "Must Step 12 happen after Step 9?", "why_question": "Why must Step 12 happen after Step 9?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: spiced-pumpkin-teabread\n\nProcedure:\n1. Preheat the oven to 180\u5c0aC (350\u5c0aF, gas mark 4).\n2. Line a 900 g (2 lb) loaf tin with baking parchment.\n3. Steam the pumpkin flesh, or cook it in just a little boiling water, for 10 minutes or until tender.\n4. Drain thoroughly, then mash with a potato masher until smooth.\n5. Add the honey and sultanas, and beat well.\n6. Sift the wholemeal and white flours and the allspice into a bowl, tipping in any bran left in the sieve.\n7. Rub in the butter with your fingertips until the mixture resembles fine breadcrumbs.\n8. Add the pumpkin mixture and beat well with a wooden spoon until evenly mixed.\n9. Tip the mixture into the prepared tin and smooth the surface.\n10. Sprinkle with the pumpkin seeds.\n11. Bake for 50 minutes or until the loaf is well risen, golden brown and firm to the touch.\n12. Allow the loaf to cool in the tin for 10 minutes, then turn it out onto a wire rack.\n13. Gently brush with the 2 tsp honey while still warm.\n14. This teabread is best served slightly warm, or within a day of making.\n\n\n1. Must Step 12 happen after Step 9?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: The loaf must cool in the tin for 10 minutes before it can be turned out onto a wire rack."}
{"plan_idx": 705, "title": "rouille", "question_idx": 705, "steps": ["In a mortar, crush the garlic to a fine mash.", "Transfer to a mixing bowl.", "Add the egg yolks, and beat into a mayonnaise while adding the olive oil.", "When the sauce is thick and smooth, stir in the cayenne pepper and saffron."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 2], "binary_question": "Must Step 3 happen after Step 2?", "why_question": "Why must Step 3 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: rouille\n\nProcedure:\n1. In a mortar, crush the garlic to a fine mash.\n2. Transfer to a mixing bowl.\n3. Add the egg yolks, and beat into a mayonnaise while adding the olive oil.\n4. When the sauce is thick and smooth, stir in the cayenne pepper and saffron.\n\n\n1. Must Step 3 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: yes\nAnswer 2: Step 3 requires the ingredients from Step 2 to be present in the mixing bowl."}
{"plan_idx": 706, "title": "lemon-zested-strawberry-shortcakes", "question_idx": 706, "steps": ["In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.", "In a bowl, combine the flour, sugar, baking powder and salt.", "Rub the butter into the flour until the mixture resembles coarse crumbs.", "Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).", "Turn onto a lightly floured surface; knead 10 times.", "Divide dough in half.", "Gently pat or roll each half into a 1 .75cm thick circle.", "Place 5cm apart on an ungreased baking tray.", "Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.", "Remove to a wire rack; cool for 15 minutes.", "Meanwhile, in a small bowl, combine butter and lemon zest; set aside.", "In a small mixing bowl, beat cream until it begins to thicken.", "Add sugar; beat until stiff peaks form.", "To assemble, split shortcakes in half.", "Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.", "Cover with shortcake top and remaining berries and cream."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 5], "binary_question": "Must Step 6 happen after Step 2?", "why_question": "Why must Step 6 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: lemon-zested-strawberry-shortcakes\n\nProcedure:\n1. In a small bowl, combine strawberries and sugar; cover and refrigerate until serving.\n2. In a bowl, combine the flour, sugar, baking powder and salt.\n3. Rub the butter into the flour until the mixture resembles coarse crumbs.\n4. Combine the milk, egg yolk and lemon zest; stir into crumb mixture until a soft dough forms (dough will be sticky).\n5. Turn onto a lightly floured surface; knead 10 times.\n6. Divide dough in half.\n7. Gently pat or roll each half into a 1 .75cm thick circle.\n8. Place 5cm apart on an ungreased baking tray.\n9. Bake at 200 C / Gas 6 for 8-10 minutes or until golden brown.\n10. Remove to a wire rack; cool for 15 minutes.\n11. Meanwhile, in a small bowl, combine butter and lemon zest; set aside.\n12. In a small mixing bowl, beat cream until it begins to thicken.\n13. Add sugar; beat until stiff peaks form.\n14. To assemble, split shortcakes in half.\n15. Place cake bottoms on dessert plates; spread with lemon butter, then top each with a 1/4 of the strawberries and whipped cream.\n16. Cover with shortcake top and remaining berries and cream.\n\n\n1. Must Step 6 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: Yes\nAnswer 2: Steps 3-5 are intervening steps that prepare the dough for further processing, so Step 6 must occur after Step 5."}
{"plan_idx": 707, "title": "chocolate-chocolate-cake", "question_idx": 707, "steps": ["Preheat the oven to 180 degrees C / Gas Mark 4.", "Place the chocolate chips, coffee and water in a microwave safe bowl.", "Microwave until chocolate is almost melted.", "Remove and whisk until mixture is smooth.", "Set aside to cool.", "Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.", "Gradually beat in sugar until light and fluffy.", "Gradually beat in egg yolks one at a time, beating well after each one.", "Slowly add the flour and beat at a low speed.", "Add the cooled chocolate to the mix and beat again.", "In a separate bowl, beat egg whites until foamy.", "Then increase speed and beat until stiff.", "Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.", "Grease a 23cm springform tin or a cake tin with deep sides.", "Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.", "Pour the mixture into the cake tin.", "Bake for I hour.", "The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.", "Note that the cake is very dense, so the top may crack when baking.", "Cool in the tin for 10 minutes to allow the cake to set.", "Then remove from the tin, and allow to cool completely, which may take several hours.", "Sift icing sugar lightly over the top for decoration."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [1, 12], "binary_question": "Must Step 13 happen after Step 2?", "why_question": "Why must Step 13 happen after Step 2?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: chocolate-chocolate-cake\n\nProcedure:\n1. Preheat the oven to 180 degrees C / Gas Mark 4.\n2. Place the chocolate chips, coffee and water in a microwave safe bowl.\n3. Microwave until chocolate is almost melted.\n4. Remove and whisk until mixture is smooth.\n5. Set aside to cool.\n6. Using a hand held mixer, beat butter and margarine together in a large bowl until creamy.\n7. Gradually beat in sugar until light and fluffy.\n8. Gradually beat in egg yolks one at a time, beating well after each one.\n9. Slowly add the flour and beat at a low speed.\n10. Add the cooled chocolate to the mix and beat again.\n11. In a separate bowl, beat egg whites until foamy.\n12. Then increase speed and beat until stiff.\n13. Fold egg white mixture, one third at a time, into the chocolate mixture until blended thoroughly.\n14. Grease a 23cm springform tin or a cake tin with deep sides.\n15. Wrap the bottom of the tin securely with greaseproof paper or foil, so it comes up about 1 .5cm on the sides.\n16. Pour the mixture into the cake tin.\n17. Bake for I hour.\n18. The cake is ready when a skewer inserted about 1 .5cm from the side of the tin comes out clean.\n19. Note that the cake is very dense, so the top may crack when baking.\n20. Cool in the tin for 10 minutes to allow the cake to set.\n21. Then remove from the tin, and allow to cool completely, which may take several hours.\n22. Sift icing sugar lightly over the top for decoration.\n\n\n1. Must Step 13 happen after Step 2?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 2 involves melting chocolate, while Step 13 involves folding egg whites into the mixture, and these steps can be done in any order."}
{"plan_idx": 708, "title": "feta-and-sundried-tomato-spinach-rolls", "question_idx": 708, "steps": ["Preheat grill.", "Mix together cream cheese, feta, sundried tomatoes, basil and garlic.", "Stir until creamy, with no lumps.", "Blanch the spinach leaves.", "Wrap a dollop of cheese mix in each spinach leaf.", "Brush with olive oil.", "Sprinkle almonds on the top or alternately roll them in the almonds", "Grill spinach rolls until slightly crispy on top.", "Let cool for 10 minutes."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [5, 8], "binary_question": "Must Step 9 happen after Step 6?", "why_question": "Why must Step 9 happen after Step 6?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: feta-and-sundried-tomato-spinach-rolls\n\nProcedure:\n1. Preheat grill.\n2. Mix together cream cheese, feta, sundried tomatoes, basil and garlic.\n3. Stir until creamy, with no lumps.\n4. Blanch the spinach leaves.\n5. Wrap a dollop of cheese mix in each spinach leaf.\n6. Brush with olive oil.\n7. Sprinkle almonds on the top or alternately roll them in the almonds\n8. Grill spinach rolls until slightly crispy on top.\n9. Let cool for 10 minutes.\n\n\n1. Must Step 9 happen after Step 6?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1: no\nAnswer 2: Step 9 does not need to happen after Step 6 because the spinach rolls need to be grilled (Step 8) before they can cool (Step 9)."}
{"plan_idx": 709, "title": "fusilli-and-meatballs", "question_idx": 709, "steps": ["Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.", "Saut\u00e9 the onion and garlic for about 5 minutes or until soft.", "Transfer 2 tablespoons of the onion mixture to a large bowl.", "Set aside.", "Whiz the tomatoes, with their juice, in a food processor until fairly smooth.", "Add to the saucepan.", "Bring to the boil over medium-high heat.", "Reduce the heat to medium-low.", "Cover and simmer, stirring often, for 30 minutes.", "Add the basil and oregano halfway through this time.", "Process the bread until crumbs form.", "Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.", "Shape into 20 meatballs about 2.5cm (1in) diameter.", "Coat a frying pan with cooking spray or olive oil and set over medium-high heat.", "Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.", "Drain on kitchen paper.", "Add the meatballs to the tomato sauce.", "Cover and cook, stirring occasionally, for 20 minutes.", "Meanwhile, cook the pasta according to the instructions on the packet.", "Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.", "Spoon the meatballs and remaining sauce over the top, then serve."], "question_type": "dependent_real_after", "step_pair_idx_asked_about": [9, 17], "binary_question": "Must Step 18 happen after Step 10?", "why_question": "Why must Step 18 happen after Step 10?", "model_name": "gemini-1.0-pro-latest", "prompt_key": "basic_binary_explain_nl", "model_input": "Given a goal, a procedure to achieve that goal and a question about the steps in the procedure, you are required to answer the questions.\n\nGoal: fusilli-and-meatballs\n\nProcedure:\n1. Coat a large saucepan with cooking spray or a teaspoon of olive oil and set over a medium-high heat.\n2. Saut\u00e9 the onion and garlic for about 5 minutes or until soft.\n3. Transfer 2 tablespoons of the onion mixture to a large bowl.\n4. Set aside.\n5. Whiz the tomatoes, with their juice, in a food processor until fairly smooth.\n6. Add to the saucepan.\n7. Bring to the boil over medium-high heat.\n8. Reduce the heat to medium-low.\n9. Cover and simmer, stirring often, for 30 minutes.\n10. Add the basil and oregano halfway through this time.\n11. Process the bread until crumbs form.\n12. Add the crumbs, beef, egg, milk and pepper to the onion mixture in the bowl and mix just until blended.\n13. Shape into 20 meatballs about 2.5cm (1in) diameter.\n14. Coat a frying pan with cooking spray or olive oil and set over medium-high heat.\n15. Cook the meatballs, in batches, for about 8 minutes or until browned on all sides.\n16. Drain on kitchen paper.\n17. Add the meatballs to the tomato sauce.\n18. Cover and cook, stirring occasionally, for 20 minutes.\n19. Meanwhile, cook the pasta according to the instructions on the packet.\n20. Drain and toss with 3 ladlefuls of the sauce in a large heated serving bowl.\n21. Spoon the meatballs and remaining sauce over the top, then serve.\n\n\n1. Must Step 18 happen after Step 10?\n2. Explain why or why not.\n\nFormat your answer as follows:\n\nAnswer 1: yes/no\nAnswer 2: your answer in one sentence\n\n", "model_answer": "Answer 1:  no\nAnswer 2: Step 10 involves adding basil and oregano to the tomato sauce, which is a separate step from adding the meatballs in Step 18."}
