,Unnamed: 0,Chapter,Midterm,Model,Condition,Question,Answer,questionId
0,1590,chapter7_5,midterm_1,GPT3,Fewshot,"
","
",1590
1,2716,slp_chapter6_12,midterm_2,T5,GoodSummary,What is a common tool used for this?,WordSim-353,2716
2,752,chapter3_4,midterm_1,GPT3,BadSummary,"What is dfs?
",Dfs is a search algorithm that uses early goal testing.,752
3,3080,slp_chapter9_3,midterm_2,T5,BadSummary,How do you get negative samples?,Randomly sample other words in the lexicon,3080
4,6339,chapter_2_4_1,1st midterm,T5,From GPT-3 generated summary,Whose actions need to depend on the entire percept sequence?,the agent,6339
5,5054,chapter_1_1_4,1st midterm,GPT3,From raw text,"What is an agent?
",An agent is something that acts.,5054
6,2832,chapter5_5,midterm_1,T5,BadSummary,How can we estimate values of nodes?,Monte Carlo simultion,2832
7,5218,chapter_3_4_1,1st midterm,GPT3,From raw text,"What is a cost-optimal search strategy?
",A cost-optimal search strategy is a search strategy that finds a solution with the minimal number of actions.,5218
8,5148,chapter_2_4_6,1st midterm,GPT3,From raw text,"What is the simplest case of learning directly from the percept sequence?
",The simplest case of learning directly from the percept sequence is when the agent learns “what my actions do” and “how the world evolves” in response to its actions.,5148
9,1290,chapter19_6,midterm_2,GPT3,Zero,"If the perceptron produces the incorrect output, then what happens to the weights?
","If the perceptron produces the incorrect output, then the weights are adjusted so that the next input will produce the correct output.",1290
10,5108,chapter_2,1st midterm,GPT3,From raw text,"How does the nature of an environment influence the design of suitable agents for that environment?
",The nature of an environment influences the design of suitable agents for that environment by affecting the properties of agent designs.,5108
11,4597,chapter17_2,midterm_2,T5,Best Condition - with Davinci,What is the maximum relative change in utility allowed?,delta,4597
12,3754,chapter2_1,midterm_1,T5,Fewshot,What is another way to fill out the table?,always move to the square with the most dirt,3754
13,2806,chapter3_2,midterm_1,T5,BadSummary,8-puzzle belongs to the family of what?,sliding-block puzzles,2806
14,3424,chapter12_7,midterm_2,T5,Zero,What can agents calculate using the probabilistic agent?,the probability that each square is a pit,3424
15,3782,chapter2_4,midterm_1,T5,Fewshot,The architecture makes the percepts from what available to the program?,sensors,3782
16,984,slp_chapter6_1,midterm_2,GPT3,BadSummary,"What is word relatedness?
",Word relatedness is the relation between two words.,984
17,6109,chapter_2_4,1st midterm,GPT3,From GPT-3 generated summary,"What is the agent-architecture design process?
",The agent-architecture design process is the process of designing agent programs that are appropriate for the agent architecture.,6109
18,4354,chapter27_1,midterm_1,T5,Best Condition - with Davinci,"For any formal axiomatic framework F powerful enough to do arithmetic, it is possible to construct a Godel sentence with",G(F),4354
19,1675,chapter12_7,midterm_2,GPT3,Fewshot,"What is a probabilistic agent?
",A probabilistic agent is an agent that calculates the probability that each square is a pit.,1675
20,2777,chapter2_4,midterm_1,T5,BadSummary,What is an agent called if it's decided actions help it reach a given goal?,goal-based,2777
21,5954,chapter_3_4_3,1st midterm,T5,From raw text,What is the deepest level of a tree-like search that does not keep a table of reached states?,search tree,5954
22,4270,slp_chapter7_7,midterm_2,T5,Fewshot,What do we often want to learn simultaneously with training the network?,embeddings,4270
23,6008,chapter_1_1,1st midterm,GPT3,From GPT-3 generated summary,"What are the strengths and weaknesses of each of these methods?
","The different approaches use different methods, and have both strengths and weaknesses.",6008
24,37,chapter7_2,midterm_1,GPT3,Best Condition - with Davinci,"What is the wumpus world similar to?
",The wumpus world is similar to the r2d2 problem.,37
25,445,chapter6_2,midterm_1,GPT3,GoodSummary,"What is the difference between constraint propagation and constraint satisfaction?
","The difference between constraint propagation and constraint satisfaction is that constraint propagation is the process of changing the values of some variables based on the values of others, and constraint satisfaction is the process of finding a solution to a set of constraints.",445
26,2557,slp_chapter5_1,midterm_2,T5,GoodSummary,Classifier multiplies each what?,x_i by each w_i,2557
27,5205,chapter_3_3_4,1st midterm,GPT3,From raw text,"1
",To,5205
28,4457,chapter3_6,midterm_1,T5,Best Condition - with Davinci,The straight line/Euclidean distance heuristic is the best heuristic if there are what?,no obstacles,4457
29,3296,chapter6_3,midterm_1,T5,Zero,What happens when a variable has no legal values left to assign?,backtracks,3296
30,593,chapter19_4,midterm_2,GPT3,GoodSummary,"What four reasons can there be for the h* function being different from the true function?
","The h* function can be different from the true function for four reasons: unrealizability, variance, noise, and computational complexity.",593
31,718,slp_chapter6_11,midterm_2,GPT3,GoodSummary,"What is an embedding?
",An embedding is an implicit bias that is embedded in texts.,718
32,1173,chapter17_3,midterm_2,GPT3,Zero,"What is the overall bandit problem?
",The overall bandit problem is an mdp: the state space is given by the cartesian product s = s1 x ... x sn,1173
33,1125,chapter7_2,midterm_1,GPT3,Zero,"What are the actuators in the wumpus world?
","The actuators in the wumpus world are forward, turn left, and turn right.",1125
34,5849,chapter_3_3,1st midterm,T5,From raw text,What corresponds to the initial state of the problem?,The root of the tree,5849
35,6019,chapter_1_1_3,1st midterm,GPT3,From GPT-3 generated summary,"What did aristotle try to create?
",Aristotle tried to create patterns for irrefutable reasoning processes.,6019
36,733,chapter27_2,midterm_1,GPT3,BadSummary,"What are mental states?
",Mental states are high,733
37,6065,chapter_27_2_2,1st midterm,GPT3,From GPT-3 generated summary,"What is the problem of consciousness?
",The problem of consciousness is the,6065
38,6169,chapter_3_3_3,1st midterm,GPT3,From GPT-3 generated summary,"What is a cycle in a search tree?
","A cycle is a path from one state to another state, and then back to the first state.",6169
39,1245,SLP_chapter3_7,midterm_2,GPT3,Zero,"What are some ways to store language models to save memory?
",Some ways to store language models to save memory include the following:,1245
40,2610,slp_chapter5_6,midterm_2,T5,GoodSummary,On what is the softmax function written?,sheet,2610
41,22,chapter6_4,midterm_1,GPT3,Best Condition - with Davinci,"What is the difference between local search and global search?
","Local search uses a complete-state formulation, which means that each state assigns a value to each variable, and the search changes a variable at a time. global search does not use a complete-state formulation, and the search changes multiple variables at a time.",22
42,3658,slp_chapter7_6,midterm_2,T5,Zero,"To train a neural net, you need what to model the distance between the system output and the gold output?",loss function,3658
43,1255,chapter13_2,midterm_2,GPT3,Zero,"What is the semantics of a bayes net?
",The semantics of a bayes net defines how the syntax corresponds to a joint distribution over the variables of the network.,1255
44,2898,chapter16_2,midterm_2,T5,BadSummary,What is the utility of a lottery?,the sum of the probability of each outcome times the utility of that outcome,2898
45,702,slp_chapter6_3,midterm_2,GPT3,GoodSummary,"What is common to use smaller contexts, generally a window around the word (4 words to the left and 4 words to the right)?
","Common to use smaller contexts, generally a window around the word (4 words to the left and 4 words to the right), in which case the cell represents the number of times (in some training corpus) the column word occurs in such a ±4 word window around the row word.",702
46,3098,slp_chapter6_8,midterm_2,T5,BadSummary,What does Word2vec do?,Randomly sample other words in the lexicon to get negative samples,3098
47,520,chapter12_2,midterm_2,GPT3,GoodSummary,"What is the sample space?
",The set of all worlds called the sample space.,520
48,6010,chapter_1_1_1,1st midterm,GPT3,From GPT-3 generated summary,"Who proposed the turing test?
",Alan turing proposed the turing test.,6010
49,3703,slp_chapter6_10,midterm_2,T5,Zero,What is the word2vec model trained on?,positive instances,3703
50,5200,chapter_3_3_4,1st midterm,GPT3,From raw text,"1
",To,5200
51,5085,chapter_27_1_3,1st midterm,GPT3,From raw text,"What is the problem with lucas's claim?
",The problem with lucas's claim is that an agent should not be ashamed that it cannot establish the truth of some sentence while other agents can.,5085
52,263,slp_chapter5_5,midterm_2,GPT3,Best Condition - with Davinci,"What is l2 regularization?
",L2 regularization is a quadratic function of the weight values.,263
53,2199,chapter17_2,midterm_2,T5,GoodSummary,What is the process of calculating a new MEU policy pi_i+1 using one-step look-ahead based on U_i,Policy improvement,2199
54,74,chapter17_1,midterm_2,GPT3,Best Condition - with Davinci,"What is the set of states for an mdp?
",The set of states for an mdp is a set of initial state s0 and a set of final states s*,74
55,3281,chapter6_1,midterm_1,T5,Zero,"If the domain of the first variable is ever emptied, what does the function return?",false,3281
56,5163,chapter_3_1_1,1st midterm,GPT3,From raw text,"What is the transition model in a search problem?
",The transition model in a search problem is the model that describes what each action does.,5163
57,4659,chapter12_1,midterm_2,T5,Best Condition - with Davinci,What does the agent's knowledge provide in the relevant sentences?,degree of belief,4659
58,612,slp_chapter4_2,midterm_2,GPT3,GoodSummary,"What is the simplest solution for smoothing a text stream?
",The simplest solution is add-one (laplace) smoothing.,612
59,104,chapter12_2,midterm_2,GPT3,Best Condition - with Davinci,"What is the uppercase greek letter omega (ω) used for?
","The uppercase greek letter omega (ω) is used to refer to the sample space, while the lowercase greek letter omega (ω) refers to elements of the space, particularly possible worlds.",104
60,447,chapter6_3,midterm_1,GPT3,GoodSummary,"What is the difference between commutativity and the order not mattering in csps?
","The difference between commutativity and the order not mattering in csps is that commutativity means that the order does not matter, and the order not mattering means that the order does not matter.",447
61,6186,chapter_3_4_3,1st midterm,GPT3,From GPT-3 generated summary,"What is depth-first search?
",Depth-first search expands the deepest node in the frontier first.,6186
62,201,chapter19_6,midterm_2,GPT3,Best Condition - with Davinci,"What if y is 0 but hw(x) is 1?
",If y is 0 but hw(x) is then wi is decreased when the corresponding input xi is positive and increased when xi is negative.,201
63,1246,SLP_chapter3_7,midterm_2,GPT3,Zero,"What are some ways to speed up the training of large language models?
",Some ways to speed up the training of large language models include the following:,1246
64,4038,chapter12_3,midterm_2,T5,Fewshot,Probabilities in the joint distribution sum to what?,1,4038
65,2213,chapter17_3,midterm_2,T5,GoodSummary,What is the best option for a Bernoulli bandit problem?,arm with highest upper bound of confidence,2213
66,6245,chapter_27_1_3,1st midterm,T5,From GPT-3 generated summary,What theory applies to computers?,Gödel's incompleteness theorem,6245
67,55,chapter16_1,midterm_2,GPT3,Best Condition - with Davinci,"In decision making with known outcomes, what is the agent's knowledge of the outcomes of the actions?
","In decision making with known outcomes, the agent knows the outcomes of the actions.",55
68,5678,chapter_2_4_1,1st midterm,T5,From raw text,What section describes the variety of ways in which the components themselves can be represented within the agent?,Section 2.4.7,5678
69,1775,slp_chapter4_7,midterm_2,GPT3,Fewshot,"What is recall?
",Recall measures the percentage of items actually present that were correctly identified by the system.,1775
70,1701,SLP_chapter3_7,midterm_2,GPT3,Fewshot,"What is it possible to build approximate language models using bloom filter techniques?
",It is possible to build approximate language models,1701
71,2151,chapter16_1,midterm_2,T5,GoodSummary,Decision theory deals with what?,choosing among actions based on the desirability of their immediate outcomes,2151
72,3628,slp_chapter5_6,midterm_2,T5,Zero,What is the weight vector for the jth class?,w_j,3628
73,143,SLP_chapter3_5,midterm_2,GPT3,Best Condition - with Davinci,"What is smoothing?
",Smoothing is the process of shaving off probability from more seen events and giving them to this unseen event.,143
74,4954,slp_chapter7_3,midterm_2,T5,Best Condition - with Davinci,What is a multilayer network in which the units are connected with no cycles?,A feedforward network,4954
75,498,chapter17_2,midterm_2,GPT3,GoodSummary,"What is monte carlo planning?
",Monte carlo planning is a decision making algorithm that uses approximate solutions to find optimal policies online.,498
76,4044,chapter12_4,midterm_2,T5,Fewshot,What can help reduce the size of the domain representation and complexity of the inference problem?,independence assertions,4044
77,5131,chapter_2_4_1,1st midterm,GPT3,From raw text,"What is a reflex agent?
",A reflex agent is an agent program that takes the current percept as input and returns an action to the actuators.,5131
78,1932,chapter2_2,midterm_1,T5,GoodSummary,What does an agent that lacks autonomy rely on instead of percepts and learning lack?,prior knowledge,1932
79,895,chapter19_4,midterm_2,GPT3,BadSummary,"What is split data into training and test set?
","Split data into training and test set is to take 1/2 of the data and use it as the training set, 1/2 of the data and use it as the test set.",895
80,4810,chapter19_3,midterm_2,T5,Best Condition - with Davinci,What can be used to combat overfitting?,Decision tree pruning,4810
81,4161,chapter19_6,midterm_2,T5,Fewshot,What is the output of the perceptron learning rule?,y = hw(x),4161
82,6464,chapter_3_4_6,1st midterm,T5,From GPT-3 generated summary,Breadth-first search expands nodes in order of increasing depth from the root.,the root is expanded first,6464
83,1515,chapter5_2,midterm_1,GPT3,Fewshot,"What can the minmax algorithm be extended to?
",The minmax algorithm can be extended to multiplayer games by making each node a vector of values.,1515
84,6373,chapter_2_4_7,1st midterm,T5,From GPT-3 generated summary,"From factored to structured, what is the axis of complexity and expressive power?",atomic,6373
85,3040,slp_chapter7_1,midterm_2,T5,BadSummary,What is a network of small computing units - each of which takes a vector of input values and produces a single output value?,Neural Network,3040
86,6258,chapter_27_2_1,1st midterm,T5,From GPT-3 generated summary,What type of symbols are slipped under the door of a room?,indecipherable,6258
87,2022,chapter5_5,midterm_1,T5,GoodSummary,What is n?,number of distinct rolls,2022
88,1651,chapter12_2,midterm_2,GPT3,Fewshot,"What is the sample space?
",The sample space is the set of all possible worlds that are mutually exclusive and exhaustive.,1651
89,1605,chapter16_2,midterm_2,GPT3,Fewshot,"What is orderability?
",Orderability is the requirement that preferences be transitive.,1605
90,1327,slp_chapter4_9,midterm_2,GPT3,Zero,"What is a naive bayes classifier?
",A naive bayes classifier is a classifier that is used in the classification of binary classification problems.,1327
91,4589,chapter17_1,midterm_2,T5,Best Condition - with Davinci,What is the probability that action a in state s reaches state s?,"P(s’|s,a)",4589
92,3696,slp_chapter6_8,midterm_2,T5,Zero,What can GPT-3 be used for?,"generate text, answer questions, and translate between languages",3696
93,66,chapter16_3,midterm_2,GPT3,Best Condition - with Davinci,"What is an absolute scale for utilities?
","There is no absolute scale for utilities, but it is helpful, nonetheless, to establish some scale on which utilities can be recorded and compared for any particular problem.",66
94,5554,chapter_2_2_3,1st midterm,T5,From raw text,What would an agent's percept sequence not tell it about?,large truck approaching at high speed,5554
95,5784,chapter_3,1st midterm,T5,From raw text,What do problem-solving agents use?,atomic representations,5784
96,4253,slp_chapter7_3,midterm_2,T5,Fewshot,What gives a probability distribution across the output nodes?,vector y,4253
97,5249,chapter_1_1_1,1st midterm,T5,From raw text,Who proposed the Turing test?,Alan Turing,5249
98,968,slp_chapter7_5,midterm_2,GPT3,BadSummary,"What is the disadvantage of neural language models over n-gram models?
",The,968
99,1837,slp_chapter7_6,midterm_2,GPT3,Fewshot,"What is a neural net?
","A neural net is a model that is composed of many layers of neurons, which are connected to",1837
100,2846,chapter6_2,midterm_1,T5,BadSummary,What does AC-3 do if $D_i$ becomes empty set?,keep checking till there are no more arcs in the queue,2846
101,6137,chapter_3,1st midterm,GPT3,From GPT-3 generated summary,"What is the simplest search algorithm?
",The simplest search algorithm is the episodic search algorithm.,6137
102,3565,slp_chapter4_7,midterm_2,T5,Zero,What measures the percentage of items that the system detected that are in fact positive?,Precision,3565
103,4127,chapter19_2,midterm_2,T5,Fewshot,What is the true label?,The ground truth,4127
104,5925,chapter_3_4,1st midterm,T5,From raw text,What is a better first step for an uninformed agent with no knowledge of Romanian geography?,Zerind or Sibiu,5925
105,4216,slp_chapter5_3,midterm_2,T5,Fewshot,"What is used to choose the parameters w,b that maximize the log probability of the true y labels in the training data given the observations x",The conditional maximum likelihood estimation,4216
106,805,chapter7_1,midterm_1,GPT3,BadSummary,What is a successful agent's setup requiring?,A successful agent's setup requires both a declarative and procedural setup.,805
107,2944,SLP_chapter3_2,midterm_2,T5,BadSummary,What is held-out set?,test set,2944
108,6272,chapter_2,1st midterm,T5,From GPT-3 generated summary,What is discussed in this chapter?,the diversity of environments,6272
109,2795,chapter3_1,midterm_1,T5,BadSummary,What is executed?,execution of the actions in the solution sequence,2795
110,6011,chapter_1_1_1,1st midterm,GPT3,From GPT-3 generated summary,"What is the purpose of the turing test?
",The purpose of the turing test is to determine if a machine can think.,6011
111,851,chapter12_4,midterm_2,GPT3,BadSummary,"How are independencies rare?
","Independencies are rare because whenever a connection (also very indirect) /exists b/w two variables, the independence fails to hold.",851
112,5115,chapter_2_2_2,1st midterm,GPT3,From raw text,"What is rational at any given time?
","Rationality depends on four things: the performance measure that defines the criterion of success, the agent",5115
113,5434,chapter_27_2,1st midterm,T5,From raw text,Who addressed the issue of whether machines can think?,Turing,5434
114,6039,chapter_27_1_1,1st midterm,GPT3,From GPT-3 generated summary,"Who championed this view?
",Hubert dreyfus championed this view.,6039
115,172,chapter19_1,midterm_2,GPT3,Best Condition - with Davinci,"What is induction?
","Induction is going from specific set of observations to general rule, while deduction is the converse.",172
116,2338,SLP_chapter3_4,midterm_2,T5,GoodSummary,What is a sentence that never occurs in the training set but does in the test set called?,zero,2338
117,521,chapter12_2,midterm_2,GPT3,GoodSummary,"What is a mutually exclusive and exhaustive set?
",A set of all worlds called the sample space that are mutually exclusive and exhaustive.,521
118,6338,chapter_2_4_1,1st midterm,T5,From GPT-3 generated summary,What may depend on the entire percept history?,the agent function,6338
119,6419,chapter_3_4,1st midterm,T5,From GPT-3 generated summary,Who knows the location of each city and can make better decisions based on that information?,informed agent,6419
120,762,chapter5_1,midterm_1,GPT3,BadSummary,"What are actions?
",Actions are the possible moves that can be made from the initial state.,762
121,4721,SLP_chapter3_2,midterm_2,T5,Best Condition - with Davinci,What is the inverse probability of a language model on a test set called?,PP,4721
122,824,chapter17_2,midterm_2,GPT3,BadSummary,"What is value iteration?
",Value iteration is an algorithm that computes the optimal policy by updating the current policy's value with the maximum error allowed in the utility of a state.,824
123,6232,chapter_27,1st midterm,T5,From GPT-3 generated summary,The text touches on what aspect of AI?,safety,6232
124,5942,chapter_3_4_1,1st midterm,T5,From raw text,How long would a search to depth take?,3 hours,5942
125,1703,chapter13_1,midterm_2,GPT3,Fewshot,"What is the difference between a bayesian network and a normal network?
","A normal network is a set of nodes and links, whereas a bayesian network is a directed graph in which each node is annotated with quantitative probability information.",1703
126,6385,chapter_3_1_1,1st midterm,T5,From GPT-3 generated summary,A sequence of actions forms what?,path,6385
127,2515,slp_chapter4_7,midterm_2,T5,GoodSummary,What do we compute in microaveraging?,precision and recall,2515
128,3886,chapter16_2,midterm_1,T5,Fewshot,What is the expected utility of a lottery?,probability of each outcome multiplied by its utility to the agent,3886
129,535,chapter12_4,midterm_2,GPT3,GoodSummary,"What is the disadvantage of decomposing large distribution tables?
",The disadvantage of decomposing large distribution tables is that it can make the table more difficult to work with.,535
130,4553,chapter7_3,midterm_1,T5,Best Condition - with Davinci,"A entails what if and only if in every model where a is true, b is true?",b,4553
131,4744,SLP_chapter3_5,midterm_2,T5,Best Condition - with Davinci,How many n-gram counts does Laplace smoothing add to all n-gram counts before normalizing them into probabilities?,one,4744
132,3214,chapter3_5,midterm_1,T5,Zero,Satisficing solutions are good enough because they do what?,"they explore fewer nodes, saving time/space",3214
133,1005,slp_chapter6_12,midterm_2,GPT3,BadSummary,"What is the intrinsic evaluation metric for vector models?
",The intrinsic evaluation metric for vector models is to test their performance on similarity: computing the correlation between an algorithm’s word similarity scores and word similarity ratings assigned by humans.,1005
134,5913,chapter_3_3_4,1st midterm,T5,From raw text,"On what grid with no obstacles, repeatedly moving forward in a straight line also follows an infinite path of new states?",infinite,5913
135,1784,slp_chapter4_10,midterm_2,GPT3,Fewshot,"What is a representational harm?
",A representational harm is a harm caused by a system that demeans a social group.,1784
136,1235,SLP_chapter3_4,midterm_2,GPT3,Zero,"What is another implication of the n-gram model being dependent on the training corpus?
",Another implication of the n-gram model being dependent on the training corpus is that n-grams do a better job of modeling the training corpus as the value of n increases.,1235
137,1149,chapter16_1,midterm_2,GPT3,Zero,"What is the difference between expected utility and expected value?
","
expected utility is the sum of the utilities of the possible outcomes of the chosen action. 
expected value is the sum of the values of the possible outcomes of the chosen action.",1149
138,1043,chapter3_3,midterm_1,GPT3,Zero,"What is the frontier?
",The frontier is the separation between an interior region (expanded) and an exterior region (reached).,1043
139,3559,slp_chapter4_6,midterm_2,T5,Zero,Naive bayes can be viewed as a set of class-specific what?,unigram language models,3559
