,Unnamed: 0,Chapter,Midterm,Model,Condition,Question,Answer,questionId
0,5039,chapter_1_1,1st midterm,GPT3,From raw text,"Who are the four groups pursuing ai?
","The four groups pursuing ai are the human-rational, human-empirical, rationalist, and behavioralist groups.",5039
1,613,slp_chapter4_2,midterm_2,GPT3,GoodSummary,"What is the problem with using the simplest solution?
","Some systems ignore stop words (the, a).",613
2,3793,chapter3_1,midterm_1,T5,Fewshot,The agent might have to try what before it finds a solution or discovers no solution is possible?,multiple sequences,3793
3,846,chapter12_3,midterm_2,GPT3,BadSummary,"P(x|e) = α ∑_y p(x,e,y)
","P(x|e) = α ∑_y p(x,e,y)",846
4,804,chapter7_1,midterm_1,GPT3,BadSummary,Might the agent's knowledge level and its implementation level differ significantly?,The agent's knowledge level and its implementation level might differ significantly.,804
5,1453,chapter27_2,midterm_1,GPT3,Fewshot,"Of whether or not computers generate understanding?
",Searle rejects the polite convention and believes that computers generate no understanding.,1453
6,3109,slp_chapter6_11,midterm_2,T5,BadSummary,What reflect the statistics of their input and amplify bias?,Embeddins,3109
7,54,chapter16_1,midterm_2,GPT3,Best Condition - with Davinci,"What are the two types of simple decisions?
",The two types of simple decisions are decision making with known outcomes and decision making with uncertain outcomes.,54
8,1585,chapter7_4,midterm_1,GPT3,Fewshot,"What are the complex sentences?
","The complex sentences are constructed from the simpler ones using logical connectives like not, and, or, implies, if and only if.",1585
9,335,slp_chapter6_10,midterm_2,GPT3,Best Condition - with Davinci,"What is the definition of $tf_{t, d}$?
","$tf_{t, d}$ is the count of times word $t$ appears in document $d$.",335
10,2442,chapter19_4,midterm_2,T5,GoodSummary,What could you try by tuning hyperparameters?,different thresholds,2442
11,236,slp_chapter4_9,midterm_2,GPT3,Best Condition - with Davinci,"What is the p-value?
","The p-value is the probability, assuming the null hypothesis is true, of seeing the δ(x) that we saw or one even greater.",236
12,5219,chapter_3_4_1,1st midterm,GPT3,From raw text,"What is an exponential-complexity search problem?
",An exponential-complexity search problem is a search problem with a time or space complexity that is exponential in the size of the search space.,5219
13,525,chapter12_3,midterm_2,GPT3,GoodSummary,"What is the probability of having a cavity 
",P(cavity) = p(cavity and toothache) / p(toothache) = 0.7 / 0.9 = 0.7,525
14,6017,chapter_1_1_2,1st midterm,GPT3,From GPT-3 generated summary,"What is the goal of the cognitive modeling approach to making a program think like a human?
",The goal of the cognitive modeling approach to making a program think like a human is to construct a sufficiently precise theory of the mind that can be expressed as a computer program.,6017
15,1210,chapter12_5,midterm_2,GPT3,Zero,"What is the formula for calculating the probability of evidence, given a hypothesis?
","The formula for calculating the probability of evidence, given a hypothesis, is p(evidence|hypothesis) = p(hypothesis|evidence)p(evidence) / p(hypothesis).",1210
16,660,slp_chapter7_1,midterm_2,GPT3,GoodSummary,"What are deep neural networks?
",Deep neural networks are neural networks with multiple layers.,660
17,6327,chapter_2_2_3,1st midterm,T5,From GPT-3 generated summary,What does the beetle plug into the beetle?,pantomimes,6327
18,6285,chapter_2_2,1st midterm,T5,From GPT-3 generated summary,"If the sequence is desirable, the agent has what?",performed well,6285
19,1613,chapter16_3,midterm_2,GPT3,Fewshot,"What is risk averse utility assessment?
",Risk averse utility assessment means that the agent wants a guaranteed payoff that is lower than the expected outcome.,1613
20,4048,chapter12_5,midterm_2,T5,Fewshot,What can the cause-effect relationship be represented as?,P(cause|effect) = (P(effect|cause)P(cause))/P(effect),4048
21,1199,chapter12_1,midterm_2,GPT3,Zero,"What is the criterion for rationality in decision theory?
",The criterion for rationality in decision theory is the maximum expected utility (meu).,1199
22,1430,slp_chapter6_10,midterm_2,GPT3,Zero,"What is a skip-gram model?
",A skip-gram model is a type of statistical model that predicts the likelihood of a word appearing near another word.,1430
23,3789,chapter3_1,midterm_1,T5,Fewshot,What types of environment do we first work with?,"episodic, single agent, fully observable, deterministic, static, discrete, and known environment",3789
24,5893,chapter_3_3_3,1st midterm,T5,From raw text,What does the BEST-FIRST-SEARCH algorithm not check?,does not check,5893
25,4207,slp_chapter5_1,midterm_2,T5,Fewshot,What is usually a function that measures the error on training examples?,The objective function,4207
26,309,slp_chapter9_3,midterm_2,GPT3,Best Condition - with Davinci,"What is the disadvantage of using dense vectors?
",The disadvantage of using dense vectors is that it is less computationally efficient than using sparse vectors.,309
27,1929,chapter2_2,midterm_1,T5,GoodSummary,What is good to design perf measure based on?,what one actually wants to be achieved,1929
28,790,chapter6_2,midterm_1,GPT3,BadSummary,"What is ac-3?

",Ac-3 is an algorithm that maintains a queue of arcs to consider.,790
29,2630,slp_chapter7_4,midterm_2,T5,GoodSummary,What is the term for NLP: Classification?,Feedforward networks,2630
30,3650,slp_chapter7_5,midterm_2,T5,Zero,Why are neural language models less interpretable than n-gram models?,more complex and slow to train,3650
31,6195,chapter_3_4_5,1st midterm,GPT3,From GPT-3 generated summary,"What is the purpose of bidirectional search?
",The purpose of bidirectional search is to speed up the search process.,6195
32,6094,chapter_2_2_3,1st midterm,GPT3,From GPT-3 generated summary,"What must we ensure to prevent an agent from engaging in underintelligent activities?
",We must ensure that we haven,6094
33,2387,chapter13_3,midterm_2,T5,GoodSummary,What can a query be answered using?,Bayes net,2387
34,829,chapter22_1,midterm_2,GPT3,BadSummary,"What is the difference between reinforcement learning and supervised learning?

",Reinforcement learning is different from supervised learning because it is not given the mdp but the agent is in the mdp.,829
35,6222,chapter_1_1_3,1st midterm,T5,From GPT-3 generated summary,What does the theory of probability allow for?,a comprehensive model of rational thought,6222
36,1727,chapter19_2,midterm_2,GPT3,Fewshot,"What is the bias-variance tradeoff?
",The bias-variance tradeoff is the tradeoff between the complexity of the hypothesis space and the computational complexity of finding a good hypothesis in that space.,1727
37,2107,chapter7_1,midterm_1,T5,GoodSummary,What is the approach to system building called?,declarative,2107
38,2316,chapter12_7,midterm_2,T5,GoodSummary,What is a good example of how to use to improve choosing a square in the Wumpus world?,theorems,2316
39,5,chapter16_3,midterm_1,GPT3,Best Condition - with Davinci,"What is a micromort?

",A micromort is one in a million chance of death.,5
40,761,chapter5_1,midterm_1,GPT3,BadSummary,"What is an initial state?
",The initial state is the starting point of the game.,761
41,4231,slp_chapter5_5,midterm_2,T5,Fewshot,What is a linear function of the weight values?,L1 regularization,4231
42,6064,chapter_27_2_2,1st midterm,GPT3,From GPT-3 generated summary,"How are the issues of consciousness in machines and animal consciousness different?
","The issue of animal consciousness concerns whether or not non-human animals are conscious, while the issue of consciousness in machines concerns whether or not non-human entities that are not animals are conscious.",6064
43,6435,chapter_3_4_1,1st midterm,T5,From GPT-3 generated summary,How much memory is needed for breadth-first search?,s,6435
44,935,slp_chapter4_8,midterm_2,GPT3,BadSummary,"What are the two main types of recurrent neural networks?
",The two main types of recurrent neural networks are lstm and rnn.,935
45,5689,chapter_2_4_2,1st midterm,T5,From raw text,What do you do if the car in front brakes and its brake lights come on?,initiate braking,5689
46,5502,chapter_2_1,1st midterm,T5,From raw text,Where does the vacuum-cleaner agent start?,square,5502
47,5724,chapter_2_4_5,1st midterm,T5,From raw text,What type of based agent chooses the action that maximizes the expected utility of the action outcomes?,utility,5724
48,3104,slp_chapter6_8,midterm_2,T5,BadSummary,What are the embeddings of Word2vec?,learned weights,3104
49,857,SLP_chapter3_5,midterm_2,GPT3,BadSummary,"What is the difference between laplace smoothing and add-k smoothing?
","Laplace smoothing adds one to all n-gram counts before normalizing them into probabilities, whereas add-k smoothing moves a bit less of the probability mass to the unseen events by adding a fractional count k.",857
50,5050,chapter_1_1_3,1st midterm,GPT3,From raw text,"1.1.what was one of the first attempts to codify “right thinking”?
","1.1.the greek philosopher aristotle was one of the first to attempt to codify “right thinking”— that is, irrefutable reasoning processes.",5050
51,100,chapter12_1,midterm_2,GPT3,Best Condition - with Davinci,"How do problem-solving and logical agents handle uncertainty?
",Problem-solving and logical agents handle uncertainty by keeping track of a belief state and generating a contingency plan handling every possible eventuality they may observe during execution.,100
52,384,chapter3_1,midterm_1,GPT3,GoodSummary,"What is a precept?
",A precept is a rule or guideline used to make a decision.,384
53,305,slp_chapter9_3,midterm_2,GPT3,Best Condition - with Davinci,"What is the process of getting dense vectors?
","The process of getting dense vectors is to treat the target word and a neighboring context word as positive examples, then randomly sample other words in the lexicon to get negative samples.",305
54,5340,chapter_1_1_5,1st midterm,T5,From raw text,What is the sole objective for a machine?,winning,5340
55,3581,slp_chapter4_9,midterm_2,T5,Zero,What random variable is created to determine if our classifier has a higher F1 than our naive Bayes classifier?,X,3581
56,1307,slp_chapter4_4,midterm_2,GPT3,Zero,"What is the main disadvantage of the bootstrapping method?
",The main disadvantage of the bootstrapping method is that it does not generalize well.,1307
57,4763,chapter13_1,midterm_2,T5,Best Condition - with Davinci,What does a Bayesian network have?,no directed cycles,4763
58,1452,chapter27_2,midterm_1,GPT3,Fewshot,"Of whether or not it is usual for people to think?
",Turing believes that it is usual to have a polite convention that everyone thinks.,1452
59,3560,slp_chapter4_6,midterm_2,T5,Zero,What model will assign higher probabilities to sentences given a positive sentiment?,positive model,3560
60,4749,SLP_chapter3_5,midterm_2,T5,Best Condition - with Davinci,What is another method of smoothing?,Add-k smoothing,4749
61,1816,slp_chapter7_1,midterm_2,GPT3,Fewshot,"What is a neural network?
","A neural network is a network of small computing units, each of which takes a vector of input values and produces a single output value.",1816
62,2576,slp_chapter5_2,midterm_2,T5,GoodSummary,In what chapter is the standard optimization algorithm for iteratively updating weights covered?,chapter,2576
63,1289,chapter19_6,midterm_2,GPT3,Zero,"If the perceptron produces the correct output, then what happens to the weights?
","If the perceptron produces the correct output, then the weights are not changed.",1289
64,2911,chapter22_1,midterm_2,T5,BadSummary,What is an alternative to supervised learning from previous chapters?,REINFORCEMENT LEARNING,2911
65,4080,SLP_chapter3_4,midterm_2,T5,Fewshot,What do a better and better job of modeling the training corpus as we increase the value of N?,n-grams,4080
66,5104,chapter_2,1st midterm,GPT3,From raw text,"What is an intelligent agent?
",An intelligent agent is a system that behaves rationally.,5104
67,312,slp_chapter6_1,midterm_2,GPT3,Best Condition - with Davinci,"What is word similarity?
",Word similarity is when two words have a similar but not identical meaning. they are not substitutable for one another in every sentence.,312
68,4576,chapter16_1,midterm_2,T5,Best Condition - with Davinci,"In decision making with known outcomes, who can use this knowledge to make a decision?",the agent knows the outcomes of the actions,4576
69,3062,slp_chapter9_1,midterm_2,T5,BadSummary,What do n-gram LMs not need?,smoothing,3062
70,6046,chapter_27_1_2,1st midterm,GPT3,From GPT-3 generated summary,"Is the argument from disability an sound argument?
","No, the argument from disability is not an sound argument.",6046
71,591,chapter19_3,midterm_2,GPT3,GoodSummary,"What is a tree?
","A tree is a structure of tests on attributes in interior nodes, value of attribute on branches, and output value of leaf nodes.",591
72,4260,slp_chapter7_5,midterm_2,T5,Fewshot,What does a feedforward neural LM output?,probability distribution over possible next words,4260
73,5111,chapter_2_1,1st midterm,GPT3,From raw text,"2.what are the four categories of actions?
","2.the four categories of actions are percept-dependent, percept-independent, built-in, and random.",5111
74,6072,chapter_2,1st midterm,GPT3,From GPT-3 generated summary,"What does it mean for an agent to behave better than another?
",It means for an agent to behave better than another it means that the first agent is better at achieving its goals than the second agent.,6072
75,3625,slp_chapter5_6,midterm_2,T5,Zero,What are the same as in a regular logistic regression?,features,3625
76,4705,chapter12_7,midterm_2,T5,Best Condition - with Davinci,A pure logical agent cannot make all the inferences necessary to solve the Wumpus world.,a pit,4705
77,3393,chapter12_1,midterm_2,T5,Zero,Problem-solving and logical agents handle uncertainty by keeping track of a belief state and generating what?,contingency plan,3393
78,5216,chapter_3_4_1,1st midterm,GPT3,From raw text,"What is a systematic search strategy?
",A systematic search strategy is a search strategy in which the search space is broken into smaller and smaller parts until the goal is found.,5216
79,1215,chapter12_6,midterm_2,GPT3,Zero,"What is a bayesian classifier sometimes called?
",A bayesian classifier is sometimes called a naive bayes model.,1215
80,2847,chapter6_2,midterm_1,T5,BadSummary,"Why can each arc $(X_k,X_i)$ be inserted only $d$ times?",$X_i$ has at most d values to delete,2847
81,2119,chapter7_3,midterm_1,T5,GoodSummary,What is used to derive sentences if KB/premises are true?,sound inferencing,2119
82,6018,chapter_1_1_2,1st midterm,GPT3,From GPT-3 generated summary,"What is the interdisciplinary field of cognitive science?
",The interdisciplinary field of cognitive science brings together,6018
83,537,chapter12_4,midterm_2,GPT3,GoodSummary,"What is the advantage of using independence?
",The advantage of,537
84,3113,slp_chapter6_12,midterm_2,T5,BadSummary,What is an example of a vector model?,Evaluating Vector Models,3113
85,5178,chapter_3_3_2,1st midterm,GPT3,From raw text,"What is a node in a search tree represented by?
","A node in a search tree is represented by a data structure with four components: state, parent, action, and path-cost",5178
86,5132,chapter_2_4_1,1st midterm,GPT3,From raw text,"What are the four basic kinds of agent programs that embody the principles underlying all intelligent systems?
","The four basic kinds of agent programs are simple reflex agents, model-based reflex agents, goal-based agents, and utility-based agents.",5132
87,5847,chapter_3_3,1st midterm,T5,From raw text,What chapter considers algorithms that superimpose a search tree over the state-space graph?,3.3,5847
88,5417,chapter_27_1_4,1st midterm,T5,From raw text,Many people have been what when they didn't know they might be chatting with a computer?,fooled,5417
89,3090,slp_chapter6_3,midterm_2,T5,BadSummary,What represent words in a term-document matrix?,rows,3090
90,1343,slp_chapter5_2,midterm_2,GPT3,Zero,"What are common supervised classification techniques?
","Common supervised classification techniques include logistic regression, decision trees, and neural networks.",1343
91,6170,chapter_3_3_4,1st midterm,GPT3,From GPT-3 generated summary,"What are the four ways in which one can measure the performance of an algorithm?
","The four ways in which one can measure the performance of an algorithm are completeness, cost optimality, time complexity, and space complexity.",6170
92,831,chapter22_2,midterm_2,GPT3,BadSummary,"What is the difference between passive learning and direct utility estimation?
","Passive learning does not require an agent to know the p(s, a, s') or r(s, a, s') and instead estimates the utility of a state using the reward and the expected utility of successor states.",831
93,1888,slp_chapter6_12,midterm_2,GPT3,Fewshot,"What task is used for evaluation of intrinsic similarity tasks that include context?
",The,1888
94,5917,chapter_3_3_4,1st midterm,T5,From raw text,"In an infinite state space with no solution, a sound algorithm needs to keep searching what?",forever,5917
95,4890,slp_chapter4_9,midterm_2,T5,Best Condition - with Davinci,What is the hypothesis H0 called?,the null hypothesis,4890
96,882,chapter19_2,midterm_2,GPT3,BadSummary,"What is the best fit function?
",The best fit function is the function that best approximates the true function f.,882
97,3563,slp_chapter4_7,midterm_2,T5,Zero,What can we build for visualizing how an algorithm performs with respect to human gold labels?,a confusion matrix,3563
98,153,chapter13_1,midterm_2,GPT3,Best Condition - with Davinci,"What is a bayesian network?
",A bayesian network is a directed graph in which each node is annotated with quantitative probability information.,153
99,648,slp_chapter5_2,midterm_2,GPT3,GoodSummary,"What is the distance between y_pred and y_true called?
",The distance between y_pred and y_true is called the loss function or the cost function.,648
100,6371,chapter_2_4_6,1st midterm,T5,From GPT-3 generated summary,What can be learned in intelligent agents?,Learning in intelligent agents,6371
101,2975,chapter13_1,midterm_2,T5,BadSummary,What does a Bayesian network have?,no directed cycles,2975
102,4788,chapter19_2,midterm_2,T5,Best Condition - with Davinci,What are the two main steps in machine learning?,training and testing,4788
103,2253,chapter22_3,midterm_2,T5,GoodSummary,What essentially becomes an exploratin POMDP?,Bayesian,2253
104,1622,chapter17_2,midterm_2,GPT3,Fewshot,"How does policy iteration work?
",Policy iteration works by iteratively improving the policy.,1622
105,2983,chapter13_2,midterm_2,T5,BadSummary,What is the value of each entry in the joint distribution?,x1,2983
106,3612,slp_chapter5_4,midterm_2,T5,Zero,What is a hyperparameter that must be adjusted by the algorithm designer?,The learning rate,3612
107,404,chapter5_1,midterm_1,GPT3,GoodSummary,"What are the two types of reasoning in a two player game?
",There are two types of reasoning in a two player game.,404
108,3811,chapter3_3,midterm_1,T5,Fewshot,What is the interior region of a node called?,expanded,3811
109,581,chapter13_3,midterm_2,GPT3,GoodSummary,"What is the worst case space complexity?
",O(n).,581
110,3617,slp_chapter5_5,midterm_2,T5,Zero,What is the Euclidean distance of the vector?? from the origin?,argmax,3617
111,4252,slp_chapter7_3,midterm_2,T5,Fewshot,What can the hidden layer computation for a feedforward network be done very efficiently with?,simple matrix operations,4252
112,4059,chapter12_7,midterm_2,T5,Fewshot,What does a probabilistic agent do?,calculates the probability that each square is a pit,4059
113,965,slp_chapter7_4,midterm_2,GPT3,BadSummary,"What are some of the benefits of using a combination of different neural network layers, rather than starting from scratch?
",One benefit of using a combination of different neural network layers is that it reduces the,965
114,6028,chapter_1_1_5,1st midterm,GPT3,From GPT-3 generated summary,,"The text argues that a better model would be one in which the machine is uncertain about the human's objectives, and therefore acts cautiously.
",6028
115,5809,chapter_3_1,1st midterm,T5,From raw text,How many sequences does the agent have to simulate to reach the goal?,multiple,5809
116,6227,chapter_1_1_5,1st midterm,T5,From GPT-3 generated summary,When does the standard model of AI assume that the machine's objective is fully specified by the human?,when the machine is intelligent enough to reason beyond the human's specifications,6227
117,6235,chapter_27_1,1st midterm,T5,From GPT-3 generated summary,"Who wrote ""aerial flight is one of the great class of problems with which man can never cope""?",Simon Newcomb,6235
118,3527,chapter19_4,midterm_2,T5,Zero,What is the number of parts used in k-fold cross validation?,k-1,3527
119,1401,slp_chapter9_3,midterm_2,GPT3,Zero,"What do you use to train a classifier?
",You use logistic regression to train a classifier.,1401
120,607,chapter19_6,midterm_2,GPT3,GoodSummary,"What is multivariable not much more complicated than linear regression?
",Multivariable,607
121,6420,chapter_3_4_1,1st midterm,T5,From GPT-3 generated summary,What is a systematic search strategy that is complete even on infinite state spaces?,Breadth-first search,6420
122,6338,chapter_2_4_1,1st midterm,T5,From GPT-3 generated summary,What may depend on the entire percept history?,the agent function,6338
123,4574,chapter7_5,midterm_1,T5,Best Condition - with Davinci,What is an automated reasoning technique that applies rules of inference directly to the sentences in our knowledge base?,Inference rules,4574
124,5122,chapter_2_3,1st midterm,GPT3,From raw text,"What is the definition of a task environment?
",A task environment is the “problem” to which a rational agent is the “solution.,5122
125,5003,slp_chapter6_1,midterm_2,T5,Best Condition - with Davinci,What is a measure of how similar two words are?,Word relatedness,5003
126,180,chapter19_2,midterm_2,GPT3,Best Condition - with Davinci,"What is exploratory data analysis?
",Exploratory data analysis is the process of looking for the best fit function for each function in the data.,180
127,1507,chapter5_1,midterm_1,GPT3,Fewshot,"What is the game tree? 
","The game tree is the set of all possible states, actions, and results from the initial state.",1507
128,5224,chapter_3_4_3,1st midterm,GPT3,From raw text,"How is depth-first search implemented?
",Depth-first search is implemented as a call to best-,5224
129,1880,slp_chapter6_11,midterm_2,GPT3,Fewshot,"What are embeddings?
",Embeddings are representations of one thing in terms of another.,1880
130,1166,chapter17_1,midterm_2,GPT3,Zero,"How can utilities, uncertainty, and sensing be incorporated into sequential decision problems?
","Utilities, uncertainty, and sensing can be incorporated into sequential decision problems by defining a utility function, specifying a probability distribution over the states, and incorporating sensors into the agent's structure.",1166
131,6113,chapter_2_4_1,1st midterm,GPT3,From GPT-3 generated summary,"What is the difference between the agent program and the agent function?
","The agent program takes the current percept as input and returns an action to the actuators, while the agent function may depend on the entire percept history.",6113
132,5716,chapter_2_4_5,1st midterm,T5,From raw text,What does a performance measure assign to any given sequence of environment states?,score,5716
133,3621,slp_chapter5_5,midterm_2,T5,Zero,What is a type of L1 regularization?,Lasso regression,3621
134,1324,slp_chapter4_8,midterm_2,GPT3,Zero,"What technique can be used to avoid overfitting?
",Laplace smoothing can be used to avoid overfitting.,1324
135,3034,slp_chapter5_5,midterm_2,T5,BadSummary,What is used to penalize large weights?,regularization,3034
136,2103,chapter7_1,midterm_1,T5,GoodSummary,What is ASKS the KB what to do?,action,2103
137,6460,chapter_3_4_6,1st midterm,T5,From GPT-3 generated summary,What algorithm may continue expanding nodes indefinitely if a goal state is not found?,depth-first search,6460
138,4419,chapter3_2,midterm_1,T5,Best Condition - with Davinci,The 8-puzzle belongs to the family of what?,sliding-block puzzles,4419
139,4830,chapter19_5,midterm_2,T5,Best Condition - with Davinci,What are the two main types of learning?,supervised learning and unsupervised learning,4830
