,Unnamed: 0,Chapter,Midterm,Model,Condition,Question,Answer,questionId
0,3339,chapter16_2,midterm_2,T5,Zero,What does the expected utility of the lottery assign to each outcome?,numerical value,3339
1,212,slp_chapter4_4,midterm_2,GPT3,Best Condition - with Davinci,"What is a unigram language model?
",A unigram language model is a model that takes in a single observation and outputs a probability distribution over the vocabulary.,212
2,6243,chapter_27_1_2,1st midterm,T5,From GPT-3 generated summary,What are some examples of X?,strawberries and cream,6243
3,925,slp_chapter4_6,midterm_2,GPT3,BadSummary,"What is the model assign probability to each sentence?
",The model assigns probability to each sentence.,925
4,141,SLP_chapter3_3,midterm_2,GPT3,Best Condition - with Davinci,"How can we generate bigrams?
"," we can generate bigrams by generating random bigrams that start with s, then choosing random bigrams stating with the next word and so on until the sentence end token is hit.",141
5,6098,chapter_2_3,1st midterm,GPT3,From GPT-3 generated summary,"Can be asked.
",Finding is the process of finding a correct ,6098
6,5435,chapter_27_2,1st midterm,T5,From raw text,What does Turing say we never have any direct evidence about the internal mental states of other humans?,mental solipsism,5435
7,3987,chapter17_3,midterm_2,T5,Fewshot,What is a specific class of sequential decision problem?,multi-armed bandit,3987
8,112,chapter12_4,midterm_2,GPT3,Best Condition - with Davinci,"What is a domain representation?
",A domain representation is a description of the state of the world that includes all of the relevant facts about the system being modeled.,112
9,4253,slp_chapter7_3,midterm_2,T5,Fewshot,What gives a probability distribution across the output nodes?,vector y,4253
10,4634,chapter22_2,midterm_2,T5,Best Condition - with Davinci,The expected utilities of the successor states are equal to the product of the transition probability and what if the percept is given?,expected total reward,4634
11,5412,chapter_27_1_4,1st midterm,T5,From raw text,What test requires a program to have a conversation (via typed messages) with an interrogator for five minutes?,Turing test,5412
12,4041,chapter12_3,midterm_2,T5,Fewshot,What are useful rules for different derivations involving probability expressions?,Marginalization and conditioning,4041
13,6158,chapter_3_3_1,1st midterm,GPT3,From GPT-3 generated summary,"What is the second step of best-first search?
",The second step of best-first search is to generate child nodes and add them to the frontier.,6158
14,5898,chapter_3_3_3,1st midterm,T5,From raw text,What is the definition of what?,.,5898
15,5023,slp_chapter6_11,midterm_2,T5,Best Condition - with Davinci,What do embeddings encode that are a property of human reasoning?,implicit associations,5023
16,6091,chapter_2_2_3,1st midterm,GPT3,From GPT-3 generated summary,"What is the difference between a rational agent and an omniscient agent?
","An omniscient agent is an agent that has perfect knowledge of the environment. a rational agent is an agent that maximizes expected performance, while an omniscient agent maximizes actual performance.",6091
17,1169,chapter17_2,midterm_2,GPT3,Zero,"What is policy iteration?
",Policy iteration is another process used to find the optimal policy for an mdp.,1169
18,4056,chapter12_7,midterm_2,T5,Fewshot,What does the agent have to make about the world based on the information it has?,inferences,4056
19,664,slp_chapter7_1,midterm_2,GPT3,GoodSummary,"What is a solution to the vanishing gradient problem?
",A solution to the vanishing gradient problem is to use,664
20,461,chapter7_1,midterm_1,GPT3,GoodSummary,"What are the operations used to add new sentences to an agent's kb?
",The operations used to add new sentences to an agent's kb are tell and ask.,461
21,6222,chapter_1_1_3,1st midterm,T5,From GPT-3 generated summary,What does the theory of probability allow for?,a comprehensive model of rational thought,6222
22,6154,chapter_3_3_1,1st midterm,GPT3,From GPT-3 generated summary,"What is the purpose of best-first search?
",The purpose of best-first search is to choose a node on the frontier with the minimum value and expand it.,6154
23,6294,chapter_2_2,1st midterm,T5,From GPT-3 generated summary,"Even when obvious pitfalls are avoided, what kind of problems remain?",knotty,6294
24,3685,slp_chapter6_2,midterm_2,T5,Zero,The word embedding can be used as a feature in what to improve the performance of tasks such as text classification and machine translation?,machine learning models,3685
25,2253,chapter22_3,midterm_2,T5,GoodSummary,What essentially becomes an exploratin POMDP?,Bayesian,2253
26,646,slp_chapter5_1,midterm_2,GPT3,GoodSummary,"What is the advantage of naive bayes over logistic regression?
",The advantage of naive bayes over logistic regression is that naive bayes can work even better on very small data sets.,646
27,6198,chapter_3_4_6,1st midterm,GPT3,From GPT-3 generated summary,"What is the difference between breadth-first search and depth-first search?
","Breadth-first search expands nodes in order of increasing depth from the root, while depth-first search expands nodes in order of increasing depth from the root, but expands the deepest node in the current frontier of the search tree before expanding any shallower nodes.",6198
28,109,chapter12_3,midterm_2,GPT3,Best Condition - with Davinci,"What is the probabilistic inference procedure for a single variable x and list of evidence variables e?
","The probabilistic inference procedure for a single variable x and list of evidence variables e is to query the probability p(x|e) can be evaluated as: p(x|e) = αp(x,e) = α ∑_y p(x,e,y).",109
29,1632,chapter22_1,midterm_2,GPT3,Fewshot,"What is model-free reinforcement learning?
",Model-free reinforcement learning is a paradigm in which the agent does not have a transition model.,1632
30,719,slp_chapter6_11,midterm_2,GPT3,GoodSummary,"What leads to allocation harm?
",Bias amplification actually occurs in vectors.,719
31,5343,chapter_1_1_5,1st midterm,T5,From raw text,What do we want machines to do?,pursue our objectives,5343
32,2974,chapter13_1,midterm_2,T5,BadSummary,Which node is said to be a parent of Y?,X,2974
33,876,chapter19_2,midterm_2,GPT3,BadSummary,"What is a training set?
",A training set is a set of example inputs used to train a function.,876
34,1135,chapter7_3,midterm_1,GPT3,Zero,"What is a model checker?
",A model checker is an algorithm that takes a kb and a sentence and checks whether the kb entails the sentence.,1135
35,3067,slp_chapter9_1,midterm_2,T5,BadSummary,What do neural LMs tend to have more of than n-gram LMs?,higher predictive accuracy,3067
36,568,SLP_chapter3_7,midterm_2,GPT3,GoodSummary,"How does a higher-order n-gram with a zero count get backed off to a lower-order n-gram?
","We simply back off to a lower order n-gram, weighed by a fixed (context-independent) weight.",568
37,3198,chapter3_3,midterm_1,T5,Zero,What does a tree like search algorithm not check for?,redundant paths,3198
38,3871,chapter5_5,midterm_1,T5,Fewshot,What time of expectimax is O(b?? m * n?? m)?,n,3871
39,318,slp_chapter6_2,midterm_2,GPT3,Best Condition - with Davinci,"What is a sequence of letters?
",A sequence of letters is a word.,318
40,4759,chapter13_1,midterm_2,T5,Best Condition - with Davinci,What does each node correspond to?,random variable,4759
41,1917,chapter2_1,midterm_1,T5,GoodSummary,What are actuators?,"motors, cervos",1917
42,2956,SLP_chapter3_4,midterm_2,T5,BadSummary,What do we need to build a language model for a question-answering system?,training corpus of questions,2956
43,415,chapter5_3,midterm_1,GPT3,GoodSummary,"What is the expected utility of a terminal state?
",The expected utility of a terminal state is the utility of the state from the current player's perspective.,415
44,3300,chapter6_3,midterm_1,T5,Zero,"What chooses the next variable to examine based on the variable with the fewest ""legal"" values remaining?",The MRV heuristic,3300
45,1318,slp_chapter4_7,midterm_2,GPT3,Zero,"What is a gold label?
",A gold label is a human-defined label that we are trying to match up to system output.,1318
46,4709,SLP_chapter3_1,midterm_2,T5,Best Condition - with Davinci,How does the chain rule allow us to compute the joint probability of a sequence of events?,by treating them as if they were independent,4709
47,6194,chapter_3_4_5,1st midterm,GPT3,From GPT-3 generated summary,"What is bidirectional search?
",Bidirectional search is an algorithm that starts at an initial state and searches forward and backwards simultaneously in the hope that the two searches will meet.,6194
48,745,chapter3_1,midterm_1,GPT3,BadSummary,"What is an action cost function additive along a path?

",An action cost function is additive along a path if the cost of a sequence of actions is the sum of the costs of the actions in the sequence.,745
49,1732,chapter19_3,midterm_2,GPT3,Fewshot,"What is the performance of a decision tree evaluated with?
","The performance of a decision tree is evaluated with a learning curve, which is the proportion of correct decisions on the test set with the training set size.",1732
50,6240,chapter_27_1_1,1st midterm,T5,From GPT-3 generated summary,What was the technology that Dreyfus criticized called?,Good Old-Fashioned AI,6240
51,3051,slp_chapter7_4,midterm_2,T5,BadSummary,What is one of the central ideas of deep learning?,pretraining,3051
52,1652,chapter12_2,midterm_2,GPT3,Fewshot,"What is ω used for?
",Ω is used to refer to the sample space.,1652
53,5410,chapter_27_1_3,1st midterm,T5,From raw text,What does Lucas assume computers cannot do?,humans can “change their minds”,5410
54,3661,slp_chapter7_6,midterm_2,T5,Zero,What allows you to compute the gradient of the loss function with respect to the network parameters?,error backpropagation,3661
55,4295,slp_chapter6_2,midterm_2,T5,Fewshot,- represent a word as a point in what kind of space?,multi-dimensional,4295
56,3869,chapter5_5,midterm_1,T5,Fewshot,What must be precise when dealing with?,expectimax evaluation functions,3869
57,3167,chapter2_3,midterm_1,T5,Zero,What is one in which the agent is the only actor?,single agent environment,3167
58,1340,slp_chapter5_2,midterm_2,GPT3,Zero,"What is supervised classification?
",Supervised classification is a machine learning technique in which a model is trained on a dataset with known labels in order to learn to predict the labels for new data.,1340
59,6297,chapter_2_2,1st midterm,T5,From GPT-3 generated summary,"For most of the book, we will assume that what can be specified correctly?",performance measure,6297
60,658,slp_chapter5_4,midterm_2,GPT3,GoodSummary,"What is the difference between stochastic gradient descent and batch training?
","Stochastic gradient descent is an online function, which minimizes the loss function by computing the gradient after each training example then nudging theta in the correct direction. batch training processes a set of training examples all at once.",658
61,6261,chapter_27_2_1,1st midterm,T5,From GPT-3 generated summary,What type of input does the system take from the outside?,Chinese sentences,6261
62,5092,chapter_27_2,1st midterm,GPT3,From raw text,"What is the difference between a simulation of thinking and actual thinking?
","A simulation of thinking is a program that acts like a human, whereas actual thinking is the process of a human using his or her brain.",5092
63,6048,chapter_27_1_3,1st midterm,GPT3,From GPT-3 generated summary,"What is the first false assumption made in the claim that machines are mentally inferior to humans?
",The first false assumption made in the claim that machines are mentally inferior to humans is that humans can establish the truth of a sentence that machines cannot.,6048
64,2500,slp_chapter4_4,midterm_2,T5,GoodSummary,How many words are clipped in each document for sentiment classification?,1,2500
65,1147,chapter7_5,midterm_1,GPT3,Zero,"What is monotonicity?
",Monotonicity is a property that states that the set of entailed sentences can only increase as information is added to the knowledge base.,1147
66,3370,chapter22_2,midterm_2,T5,Zero,What is a technique called that involves estimating the expected utility of successor states?,direct utility estimation,3370
67,5058,chapter_27,1st midterm,GPT3,From raw text,How do philosophers ,The,5058
68,3625,slp_chapter5_6,midterm_2,T5,Zero,What are the same as in a regular logistic regression?,features,3625
69,755,chapter3_4,midterm_1,GPT3,BadSummary,"What is the difference between ucs and dfs?
","The difference between ucs and dfs is that ucs uses a priority queue, and dfs uses a stack.",755
70,155,chapter13_1,midterm_2,GPT3,Best Condition - with Davinci,"What is a directed cycle?
",A directed cycle is a graph with a path that starts and ends at the same node.,155
71,5050,chapter_1_1_3,1st midterm,GPT3,From raw text,"1.1.what was one of the first attempts to codify “right thinking”?
","1.1.the greek philosopher aristotle was one of the first to attempt to codify “right thinking”— that is, irrefutable reasoning processes.",5050
72,961,slp_chapter7_2,midterm_2,GPT3,BadSummary,"What is a network formed by many layers of purely linear units?
",A network formed by many,961
73,3085,slp_chapter6_1,midterm_2,T5,BadSummary,What is one way to represent the meaning of a word?,how to represent the meaning of a word,3085
74,4514,chapter6_2,midterm_1,T5,Best Condition - with Davinci,What does AC-3 maintain a queue of to consider?,arcs,4514
75,91,chapter22_3,midterm_2,GPT3,Best Condition - with Davinci,"What is needed in order for an active reinforcement learning agent to learn a complete transition model with outcome probabilities for all actions?
","In order for an active reinforcement learning agent to learn a complete transition model with outcome probabilities for all actions, the agent needs to learn utilities defined by the optimal policy via the bellman equation.",91
76,1627,chapter17_3,midterm_2,GPT3,Fewshot,"What is the goal of a bandit problem?

","The goal of a bandit problem is to decide which arm to choose, in order to maximize the expected reward.",1627
77,160,chapter13_2,midterm_2,GPT3,Best Condition - with Davinci,"What is a generic entry in the joint distribution of a bayes net?
","A generic entry in the joint distribution of a bayes net is p(x..., xn), where x..., xn are the variables of the bayes net.",160
78,5135,chapter_2_4_1,1st midterm,GPT3,From raw text,"What is a utility-based agent?
","A utility-based agent is an agent program that takes the current percept as input and returns an action to the actuators, where the",5135
79,203,slp_chapter4_1,midterm_2,GPT3,Best Condition - with Davinci,"What is bayesian inference?
",Bayesian inference is a technique that can be used to perform inference or reasoning. this idea of bayesian inference was first applied to text classification.,203
80,1574,chapter7_2,midterm_1,GPT3,Fewshot,"What are the actuators of the wumpus world?
","The actuators of the wumpus world are forward, turn left, and turn right.",1574
81,4859,slp_chapter4_2,midterm_2,T5,Best Condition - with Davinci,In what model is the size of the model fixed and the value of the parameters not known?,parametric model,4859
82,2741,chapter2_3,midterm_1,T5,BadSummary,What helps all their performance measures?,avoiding collisions,2741
83,2865,chapter7_5,midterm_1,T5,BadSummary,What can be used as inference rules?,Any logical equivalences can be used as inference rules,2865
84,871,chapter19_1,midterm_2,GPT3,BadSummary,"What are the components of an agent?
","The components of an agent include: a direct mapping from current state to action, a means to infer relevant properties of the world, and information about the way world evolves and the results of actions an agent takes.",871
85,4172,slp_chapter4_4,midterm_2,T5,Fewshot,What does each model for a class instantiate?,Each model for a class instantiates a unigram language model,4172
86,1396,slp_chapter9_2,midterm_2,GPT3,Zero,"What is a neural lm simultaneously learning?
",A neural lm simultaneously learns the word vectors and the parameters of the function.,1396
87,5687,chapter_2_4_2,1st midterm,T5,From raw text,What occur even in more complex environments?,Simple reflex behaviors,5687
88,4541,chapter7_1,midterm_1,T5,Best Condition - with Davinci,What language can a lot of things in knowledge bases be expressed in?,knowledge representation language,4541
89,3038,slp_chapter5_6,midterm_2,T5,BadSummary,How many classes does multinomial logistic regression have?,more than 2 classes,3038
90,5160,chapter_3_1_1,1st midterm,GPT3,From raw text,"What is the initial state in a search problem?
",The initial state in a search problem is the state in which the agent starts.,5160
91,5085,chapter_27_1_3,1st midterm,GPT3,From raw text,"What is the problem with lucas's claim?
",The problem with lucas's claim is that an agent should not be ashamed that it cannot establish the truth of some sentence while other agents can.,5085
92,4883,slp_chapter4_8,midterm_2,T5,Best Condition - with Davinci,What does training data consist of?,input-output pairs,4883
93,5267,chapter_1_1_2,1st midterm,T5,From raw text,What is cognitive science worthy of?,several textbooks and at least one encyclopedia,5267
94,1689,SLP_chapter3_4,midterm_2,GPT3,Fewshot,"What is the n-gram model?
",The n-gram model is a statistical model that is used to predict the next word in a sequence based on the previous n words.,1689
95,5206,chapter_3_3_4,1st midterm,GPT3,From raw text,"1
",To,5206
96,1954,chapter3_1,midterm_1,T5,GoodSummary,State space can be represented as a graph where what are states and directed edges?,vertices,1954
97,994,slp_chapter6_8,midterm_2,GPT3,BadSummary,"What is word2vec?
",Word2vec is a way of learning the probability of a word occurring close to another word.,994
98,5102,chapter_27_2_2,1st midterm,GPT3,From raw text,"Of consciousness?

",The ,5102
99,1019,chapter2_1,midterm_1,GPT3,Zero,"Otherwise, what does the agent do?
","Otherwise, the agent moves to another square.",1019
100,6146,chapter_3_1_2,1st midterm,GPT3,From GPT-3 generated summary,"What is a good problem formulation? 
",A good problem formulation is one that has the right level of detail.,6146
101,1639,chapter22_3,midterm_2,GPT3,Fewshot,"What is the difference between active reinforcement learning and reinforcement learning?
",The difference between active reinforcement learning and reinforcement learning is that active reinforcement learning requires the agent to also figure out which actions to take.,1639
102,2938,chapter12_6,midterm_2,T5,BadSummary,What is a __naive Bayes__ model sometimes called?,__Bayesian classifier,2938
103,6013,chapter_1_1_1,1st midterm,GPT3,From GPT-3 generated summary,"What are the six disciplines that compose most of ai?
","The six disciplines that compose most of ai are computer vision, speech recognition, robotics, computer navigation, natural language processing, and",6013
104,487,chapter16_3,midterm_2,GPT3,GoodSummary,"Given max/min utility, can assess utility of any prize s by having agent choose between s and standard lottery, adjusting p until agent is indifferent between
","Given the max/min utility, we can assess utility of any prize s by having the agent choose between s and the standard lottery, adjusting p until the agent is indifferent between s and the standard lottery.",487
105,5995,chapter_3_4_5,1st midterm,T5,From raw text,When do we have a solution?,when the two frontiers collide,5995
106,1290,chapter19_6,midterm_2,GPT3,Zero,"If the perceptron produces the incorrect output, then what happens to the weights?
","If the perceptron produces the incorrect output, then the weights are adjusted so that the next input will produce the correct output.",1290
107,4259,slp_chapter7_5,midterm_2,T5,Fewshot,What does a feedforward neural LM take as input at time t?,a representation of some number of previous words,4259
108,5185,chapter_3_3_3,1st midterm,GPT3,From raw text,"3.3.what is a cycle?
",3.3.a cycle is a special case of a redundant path.,5185
109,6365,chapter_2_4_6,1st midterm,T5,From GPT-3 generated summary,What is needed when trying to learn a reflex component or a utility function?,Information from the external standard,6365
110,4682,chapter12_3,midterm_2,T5,Best Condition - with Davinci,"What can be evaluated as: P(X|e) =?? P(X,e) =???? _y P(",P(X|e),4682
111,6000,chapter_3_4_5,1st midterm,T5,From raw text,What can bidirectional uniform-cost search do?,result in a considerable speedup,6000
112,1684,SLP_chapter3_3,midterm_2,GPT3,Fewshot,"What is sampling from a distribution?
",Sampling from a distribution chooses random points according to their likelihood.,1684
113,2982,chapter13_2,midterm_2,T5,BadSummary,What is a generic entry in the joint distribution?,"P(x1,...,xn)",2982
114,754,chapter3_4,midterm_1,GPT3,BadSummary,"What is the difference between bfs and dfs?
","The difference between bfs and dfs is that bfs uses late goal testing, and dfs uses early goal testing.",754
115,1541,chapter16_3,midterm_1,GPT3,Fewshot,"What is the expected utility of a lottery?
",The expected utility of a lottery is the sum of the expected utilities of all the possible outcomes of the lottery.,1541
116,3432,SLP_chapter3_1,midterm_2,T5,Zero,How can the probabilities in an N-gram model be estimated?,relative frequencies of the N-grams in a dataset,3432
117,2185,chapter17_1,midterm_2,T5,GoodSummary,"If using discounted utilities with infinite horizons, optimal policy is independent of what?",starting state,2185
118,1848,slp_chapter9_3,midterm_2,GPT3,Fewshot,"What do you need in order to train a classifier?
","In order to train a classifier, you need to treat the target word and a neighboring context word as positive examples.",1848
119,1274,chapter19_2,midterm_2,GPT3,Zero,"What is the bias-variance tradeoff?
",The bias-variance tradeoff is between complexity; more complex models have lower bias and lower variance and thus generalized better.,1274
120,709,slp_chapter6_8,midterm_2,GPT3,GoodSummary,"What are the advantages of dense vectors over sparse?
",Fewer parameters to train; better than capturing synonymy.,709
121,6129,chapter_2_4_6,1st midterm,GPT3,From GPT-3 generated summary,"What is the most important distinction in learning agents?
","The most important distinction in learning agents is between the learning element, which is responsible for making improvements, and the performance element, which is responsible for selecting external actions.",6129
122,2579,slp_chapter5_3,midterm_2,T5,GoodSummary,What is the resulting loss called?,cross-entropy loss,2579
123,3635,slp_chapter7_1,midterm_2,T5,Zero,What saturates for large values of z?,sigmoid,3635
124,2639,slp_chapter7_6,midterm_2,T5,GoodSummary,"In neural networks, what do we do with small random numbers?",initialize the weights,2639
125,5229,chapter_3_4_5,1st midterm,GPT3,From raw text,"What is the advantage of bidirectional search over iterative deepening search?
",The advantage of bidirectional search over iterative deepening search is that it can find optimal solutions faster.,5229
126,6343,chapter_2_4_2,1st midterm,T5,From GPT-3 generated summary,What does a simple reflex agent choose actions based on?,the current percept,6343
127,6337,chapter_2_4_1,1st midterm,T5,From GPT-3 generated summary,The agent programs that we design in this book all have the same skeleton: they take what as input from the sensors and return an action to the,current percept,6337
128,5,chapter16_3,midterm_1,GPT3,Best Condition - with Davinci,"What is a micromort?

",A micromort is one in a million chance of death.,5
129,2622,slp_chapter7_2,midterm_2,T5,GoodSummary,What can be viewed as forming a representation for the input?,hidden layer of the network,2622
130,831,chapter22_2,midterm_2,GPT3,BadSummary,"What is the difference between passive learning and direct utility estimation?
","Passive learning does not require an agent to know the p(s, a, s') or r(s, a, s') and instead estimates the utility of a state using the reward and the expected utility of successor states.",831
131,4157,chapter19_6,midterm_2,T5,Fewshot,What is a decision boundary?,"a line (or a surface, in higher dimensions) that separates two classes",4157
132,2321,SLP_chapter3_1,midterm_2,T5,GoodSummary,"In practice, it is more common to use how many grams instead of 2 grams?",3 or 4 grams,2321
133,2224,chapter22_1,midterm_2,T5,GoodSummary,What may be unkown or known?,Model,2224
134,370,chapter2_2,midterm_1,GPT3,GoodSummary,"What is rationality?
","Rationality depends on performance measure, agent's prior knowledge \
of the environment, actions, and the percent sequence so far.",370
135,1045,chapter3_3,midterm_1,GPT3,Zero,"What is a search data structure?
",A search data structure is a data structure that is used to store information needed during search.,1045
136,4657,chapter12_1,midterm_2,T5,Best Condition - with Davinci,What can an agent use to deal with uncertainty?,logic,4657
137,5855,chapter_3_3_1,1st midterm,T5,From raw text,What is a very general approach to decide which node from the frontier to expand next?,best-first search,5855
138,6227,chapter_1_1_5,1st midterm,T5,From GPT-3 generated summary,When does the standard model of AI assume that the machine's objective is fully specified by the human?,when the machine is intelligent enough to reason beyond the human's specifications,6227
139,954,slp_chapter7_1,midterm_2,GPT3,BadSummary,"What are the three components of a neural network?
","The three components of a neural network are a set of inputs, a set of outputs, and a set of neural units.",954
