############################################################
                    FIRST TOKEN EXAMPLES 
############################################################

QA First Token, Baseline
------------------------
["[CLS]", "Who", "stars", "in", "The", "Matrix", "?", "[SEP]"]
Gradient:
    [0.00094, 0.02365, 0.02870, 0.00269, 0.00695, 0.00633, 0.00549, 0.00131]
    [0.012, 0.311, 0.377, 0.035, 0.091, 0.083, 0.072, 0.017] # renormalized
    
SmoothGrad:
    [0.00691, 0.03872, 0.04425, 0.01383, 0.00553, 0.02213, 0.01106, 0.00691]
    [0.046, 0.259, 0.296, 0.093, 0.037, 0.148, 0.074, 0.046] # renormalized 

InteGrad: 
    [0.006, 0.115, 0.025, 0.027, 0.017, 0.006, 0.078, 0.001]
    [0.022, 0.418, 0.091, 0.098, 0.062, 0.022, 0.284, 0.004] # renormalized 

QA First Token, Simple Combined
-------------------------------
["[CLS]", "Who", "stars", "in", "The", "Matrix", "?", "[SEP]"]
Gradient:
    [0.00070, 0.26421, 0.02180, 0.00203, 0.00524, 0.00481, 0.00418, 0.00098]
    [0.002, 0.869, 0.072, 0.007, 0.017, 0.016, 0.014, 0.003] # renormalized 

SmoothGrad:
    [0.00282, 0.24234, 0.03381, 0.01691, 0.01691, 0.01761, 0.00845, 0.00000]
    [0.008, 0.715, 0.1  , 0.05 , 0.05 , 0.052, 0.025, 0.   ] # renormalized 

InteGrad: 
    [0.006, 0.109, 0.026, 0.027, 0.017, 0.006, 0.078, 0.001]
    [0.022, 0.404, 0.096, 0.1  , 0.063, 0.022, 0.289, 0.004] # renormalized 

############################################################
                    STOP TOKEN EXAMPLES 
############################################################

["[CLS]", "Who", "caught", "the", "touchdown", "pass", "?", "[SEP]", "[SEP]", "Only", "after", "a", "total", "black", "##out", "caused", "an", "eight", "-", "minute", "play", "stop", "##page", "did", "Manning", "finally", "put", "the", "Giants", "'", "first", "touchdown", "on", "the", "board", ",", "in", "the", "form", "of", "a", "5", "-", "yard", "pass", "to", "Manning", "##ham", ".", "[SEP]"]

QA Stop Token, Baseline 
-----------------------
["[CLS]", "Who", "caught", "the", "touchdown", "pass", "?", "[SEP]"]
Gradient:
    [0.00297, 0.00234, 0.03719, 0.01255, 0.07713, 0.02192, 0.00866, 0.00494]
    [0.018, 0.014, 0.222, 0.075, 0.46 , 0.131, 0.052, 0.029] # renormalized

SmoothGrad: 
    [0.01297, 0.00972, 0.06807, 0.00162, 0.06483, 0.00162, 0.00486, 0.00972]
    [0.075, 0.056, 0.393, 0.009, 0.374, 0.009, 0.028, 0.056] # renormalized

InteGrad: 
    [0.000, 0.214, 0.005, 0.003, 0.008, 0.004, 0.079, 0.038]
    [0.   , 0.61 , 0.014, 0.009, 0.023, 0.011, 0.225, 0.108] # renormalized

QA Stop Token, Simple Combined 
------------------------------
["[CLS]", "Who", "caught", "the", "touchdown", "pass", "?", "[SEP]"]
Gradient:
    [0.00218, 0.00194, 0.01736, 0.29887, 0.05920, 0.02002, 0.00578, 0.00403]
    [0.005, 0.005, 0.042, 0.73 , 0.145, 0.049, 0.014, 0.01 ] # renormalized

SmoothGrad:
    [0.01379, 0.00000, 0.02757, 0.08272, 0.00000, 0.00948, 0.01551, 0.04826]
    [0.07 , 0.   , 0.14 , 0.419, 0.   , 0.048, 0.079, 0.245] # renormalized 

InteGrad: 
    [0.001, 0.211, 0.008, 0.012, 0.009, 0.002, 0.077, 0.035]
    [0.003, 0.594, 0.023, 0.034, 0.025, 0.006, 0.217, 0.099] # renormalized 

Question: Who caught the touchdown pass?
Context: Only after a total blackout caused an eight-minute play stoppage did Manning finally put the Giants' first touchdown on the board, in the form of a 5-yard pass to Manningham. 

