File size: 30,388 Bytes
cf4cc7a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
=== Comprehensive Similarity Analysis - Example 16 ===
Model Type: Bidirectional
Aggregation Method: top_k_pairs
Pair Score Method: cosine

=== SIMILARITY MATRICES ===

RAW EMBEDDINGS (Sentence Encoder):
[[0.65345544 0.6645175  0.576836   0.6319817  0.57515734 0.61215323
  0.5872103  0.6396522  0.6045585  0.4905169  0.59713715 0.5569561
  0.64737576 0.589263   0.5609218  0.622501   0.6424248  0.6236921
  0.5761621  0.56515867 0.6277555  0.6207185  0.61341447 0.636519
  0.64104354 0.59991837 0.64347464 0.6063532  0.51296395 0.6144716
  0.6913737  0.6318737  0.6167907  0.5652977  0.6090086  0.53298396
  0.6270906  0.6324867  0.61536855 0.60612917 0.621299   0.5150033
  0.58338803 0.53689015 0.5688612  0.54952055 0.61015064 0.55361754
  0.53302324 0.47228312 0.57319736 0.5048531  0.45553985 0.5259144
  0.54476523 0.50925624 0.5305835  0.6390908  0.49845067 0.47333214
  0.5988155  0.5907745  0.5392868  0.53094196 0.5202199  0.52322954
  0.52018404 0.569832   0.5080072 ]
 [0.6159653  0.55716604 0.5545561  0.6148987  0.61543673 0.6750793
  0.60624355 0.6334585  0.6085664  0.61102927 0.5608191  0.52900946
  0.57166874 0.5996033  0.637726   0.6100671  0.62454194 0.6237863
  0.67156655 0.6634091  0.67610276 0.6536133  0.6171324  0.6519129
  0.6561924  0.6061345  0.6796298  0.7166303  0.61750805 0.6180428
  0.58534014 0.60681456 0.56751335 0.5443233  0.6479847  0.5401229
  0.6227519  0.6120011  0.62884486 0.6027461  0.6380649  0.57139075
  0.6817216  0.5764179  0.6684339  0.5913826  0.62090904 0.5616588
  0.5282261  0.49384487 0.58275425 0.56847465 0.51669693 0.5467322
  0.52845114 0.52384025 0.49695754 0.6214008  0.56162536 0.5875986
  0.56412345 0.5512498  0.56141484 0.5368023  0.55948764 0.60111296
  0.604897   0.6202318  0.5167221 ]
 [0.64818037 0.63402396 0.605868   0.64437497 0.6286479  0.66732883
  0.6001124  0.64391136 0.6039071  0.5390072  0.56806874 0.5513964
  0.6354599  0.62258536 0.6356605  0.61834484 0.6462587  0.6367683
  0.60682076 0.5922472  0.664803   0.6655355  0.62764335 0.6337522
  0.67992306 0.6512024  0.6510771  0.6294801  0.55237526 0.62370336
  0.6276375  0.6402284  0.60155374 0.55978817 0.6364021  0.5158292
  0.6338916  0.6406541  0.63178444 0.61213076 0.63800144 0.5447371
  0.6095974  0.5749216  0.6140997  0.5748501  0.599535   0.5605353
  0.5510845  0.50820625 0.6151706  0.55191547 0.5096817  0.5640606
  0.5507025  0.5290519  0.5129364  0.61875314 0.54480654 0.54179007
  0.6024458  0.5613233  0.5779467  0.5865867  0.5377984  0.52813846
  0.5590593  0.6124243  0.539076  ]
 [0.6172557  0.5836475  0.58516026 0.65278035 0.5905344  0.61933523
  0.53833807 0.5864141  0.5649231  0.5374927  0.5573279  0.590322
  0.60019773 0.5768496  0.56264555 0.5884807  0.65132934 0.63520646
  0.57285964 0.59209836 0.6047245  0.58311594 0.5536592  0.62134135
  0.610619   0.56876    0.6127515  0.5946498  0.5606669  0.60336596
  0.65216136 0.6171793  0.57580703 0.5605991  0.5808795  0.53432566
  0.6058899  0.67108256 0.5828146  0.58392674 0.5955795  0.5273474
  0.6028384  0.56217325 0.57000065 0.5590135  0.57418907 0.5232535
  0.52396417 0.49703062 0.58698857 0.49947247 0.48730585 0.5458769
  0.53529215 0.5219696  0.51712054 0.6049922  0.4856928  0.501032
  0.5717784  0.55015767 0.5300305  0.5416859  0.512365   0.5608413
  0.5671352  0.51454103 0.5156795 ]
 [0.6634358  0.6354317  0.58658606 0.64851356 0.6440482  0.66945183
  0.58662057 0.66745037 0.59177375 0.54998994 0.55437165 0.52102613
  0.60814977 0.63053995 0.65404314 0.64177966 0.6506485  0.63737726
  0.62072784 0.64172    0.6921757  0.67609936 0.6418427  0.6432948
  0.6996159  0.6255831  0.6848407  0.6555845  0.5913299  0.64944965
  0.6156237  0.64090353 0.5854488  0.5305419  0.6541339  0.5649723
  0.64871913 0.6381414  0.6513231  0.6118939  0.6606025  0.549253
  0.61899936 0.6072743  0.6720096  0.590229   0.6131763  0.5692008
  0.5534359  0.51371914 0.61875004 0.5612084  0.5082477  0.5561084
  0.5529946  0.5361867  0.50021034 0.65012383 0.5632525  0.56525546
  0.6079833  0.5522096  0.5819869  0.5869678  0.54686093 0.54303944
  0.56032133 0.6194329  0.5225141 ]
 [0.66271377 0.6565149  0.645737   0.6720731  0.61902684 0.65282285
  0.60827243 0.6902034  0.63445485 0.57292056 0.617157   0.5207853
  0.62922454 0.6229038  0.6341936  0.65716815 0.66296196 0.6498708
  0.645138   0.64461106 0.71361786 0.6915778  0.6416241  0.6765347
  0.7226728  0.66048706 0.71494454 0.69121236 0.5997896  0.667148
  0.64653707 0.6904353  0.6224859  0.59499186 0.676259   0.5855563
  0.67441845 0.65386474 0.66658854 0.65515393 0.67794603 0.5873244
  0.66543245 0.59873    0.63550925 0.61695033 0.642184   0.56643355
  0.5555763  0.5321759  0.61334443 0.5780265  0.5267308  0.56090504
  0.57121205 0.56034005 0.5320287  0.6202428  0.57928497 0.56254673
  0.64217174 0.62057406 0.5858587  0.5892306  0.56692696 0.5933446
  0.5953787  0.6205989  0.5681782 ]
 [0.6559881  0.643913   0.59904665 0.6440132  0.6426948  0.6671944
  0.6024228  0.67142004 0.6166542  0.5547028  0.55665994 0.5447988
  0.61593515 0.62790537 0.66237056 0.63245445 0.6490594  0.63366884
  0.62500405 0.64763    0.6900468  0.67243826 0.63867396 0.636352
  0.6922008  0.64168286 0.6853135  0.658527   0.5815963  0.6425815
  0.61287814 0.6356627  0.5919505  0.5466018  0.64416015 0.5476427
  0.63002515 0.63831395 0.64557743 0.59293896 0.65644795 0.5485628
  0.6275881  0.6048073  0.6723446  0.6012424  0.6081319  0.563076
  0.55274576 0.5114884  0.6165879  0.5599177  0.51964974 0.5515548
  0.54841566 0.5189909  0.50577444 0.63638955 0.60154295 0.60633564
  0.61116064 0.565539   0.601669   0.6172199  0.5684005  0.56364596
  0.5707058  0.649145   0.5358405 ]
 [0.6485029  0.66159093 0.63868535 0.66413033 0.61324227 0.65780455
  0.6063069  0.6988127  0.63791937 0.57332164 0.6075757  0.51690006
  0.6282733  0.60527843 0.6199862  0.6471096  0.6590257  0.64013875
  0.6387435  0.6419652  0.7159316  0.6885669  0.63755524 0.6722939
  0.7252396  0.649423   0.7129532  0.68177384 0.5946817  0.6598172
  0.64412373 0.69262564 0.61918074 0.60269403 0.67158145 0.58935314
  0.6665178  0.6463618  0.65542567 0.6397775  0.6676294  0.5810012
  0.6517375  0.5986844  0.6244558  0.60303235 0.6265421  0.558874
  0.5420226  0.5334496  0.6248012  0.56218976 0.52823716 0.5615907
  0.57990205 0.5606635  0.53916335 0.6062989  0.55508924 0.54229856
  0.63805145 0.6173254  0.579059   0.58051825 0.5436485  0.5842484
  0.5858377  0.6043181  0.55666655]]

CONTEXTUALIZED SIMILARITIES (After Attention):
[[0.9311629  0.943396   0.9236497  0.93327445 0.9131115  0.87540627
  0.8738508  0.8943546  0.87601936 0.8426343  0.8845338  0.876252
  0.9193424  0.90286636 0.8955095  0.9199384  0.93581784 0.9326008
  0.8920946  0.8990042  0.8764097  0.89377326 0.9037999  0.9179422
  0.9056802  0.9002224  0.90275234 0.89674443 0.8661198  0.9240735
  0.9388188  0.91721773 0.9197044  0.87859726 0.900022   0.88866484
  0.9289206  0.9336384  0.918783   0.9199386  0.92065585 0.8634241
  0.879944   0.8982182  0.88934624 0.8915471  0.92097324 0.8628692
  0.8622595  0.8421096  0.87870705 0.8487543  0.8336701  0.851013
  0.8676176  0.8527061  0.8665815  0.9021489  0.8749874  0.84701973
  0.8977191  0.9034098  0.8778322  0.8847587  0.8592186  0.87505597
  0.86122054 0.86076266 0.8621425 ]
 [0.92354345 0.9124191  0.9207597  0.93242794 0.93117034 0.9004669
  0.88442874 0.896727   0.8815524  0.88762355 0.8764317  0.8708388
  0.89866316 0.91080004 0.9256173  0.9204411  0.93473923 0.93742543
  0.9283919  0.93631345 0.8966458  0.9090966  0.9095373  0.9277076
  0.91524416 0.9067563  0.9192175  0.9377335  0.9056509  0.92996913
  0.90848    0.91351914 0.90771496 0.87558484 0.9174661  0.8953336
  0.93223435 0.93166095 0.92792594 0.9234344  0.93091404 0.88672036
  0.91700244 0.9159936  0.92693144 0.910032   0.9292257  0.86961377
  0.86459327 0.8533226  0.8861407  0.87441194 0.858581   0.8620062
  0.86607295 0.8615872  0.85892564 0.9007588  0.90078485 0.89006275
  0.89042723 0.8943723  0.889523   0.8909746  0.8766395  0.9057531
  0.8940164  0.88178813 0.8690909 ]
 [0.93292856 0.9368521  0.93696666 0.940815   0.93439835 0.897077
  0.8819829  0.89939284 0.8796064  0.8630473  0.8786394  0.8782972
  0.91900617 0.9175755  0.92387867 0.9221635  0.940534   0.9403884
  0.90593606 0.9116291  0.8921445  0.9120575  0.91216373 0.92058516
  0.92186403 0.9208238  0.90878886 0.90791845 0.8832311  0.93067586
  0.92141944 0.92353016 0.9183012  0.8806424  0.9126606  0.8867581
  0.93468505 0.93978465 0.9277621  0.9255423  0.9296884  0.87746054
  0.89230156 0.91471374 0.9079354  0.90380675 0.92107385 0.86916244
  0.8723766  0.85863596 0.8964256  0.8687328  0.8564855  0.8678961
  0.8736022  0.86350316 0.86462426 0.8991031  0.89468116 0.87428415
  0.9026709  0.8973142  0.8947147  0.90732217 0.86919755 0.8806315
  0.8782019  0.8788173  0.8767684 ]
 [0.9219403  0.91927016 0.92908794 0.94286555 0.9208414  0.88021696
  0.8598228  0.879294   0.86516774 0.86084175 0.8735271  0.889983
  0.9062842  0.90127754 0.8986057  0.91128546 0.941497   0.9391283
  0.8935041  0.91051924 0.8713061  0.88389575 0.886475   0.9155839
  0.89830375 0.8923932  0.89524996 0.89542663 0.8845871  0.9230668
  0.9286207  0.9149959  0.9085957  0.8794029  0.8932568  0.8915633
  0.92460376 0.94909996 0.91063446 0.91516596 0.914812   0.86995304
  0.88885176 0.9092644  0.89221585 0.89722174 0.9116183  0.8548975
  0.86149013 0.8528773  0.88575464 0.8491681  0.84682435 0.86007464
  0.8667492  0.8593243  0.86427104 0.8934246  0.87299615 0.8587222
  0.8911807  0.89219326 0.8771043  0.89083487 0.8588368  0.89021677
  0.8794304  0.8445448  0.86708426]
 [0.9335584  0.9329266  0.926133   0.93780136 0.9350783  0.8934563
  0.8731417  0.90277153 0.8712376  0.86236316 0.86968803 0.86368227
  0.9056372  0.91582114 0.92555684 0.9255046  0.9376037  0.93621206
  0.90615946 0.92356914 0.8967502  0.9111756  0.91247994 0.91936195
  0.92393565 0.90800136 0.9154565  0.91211337 0.8918771  0.9347583
  0.9131403  0.91938984 0.9085531  0.86641574 0.91412634 0.8989461
  0.9351691  0.934599   0.9298122  0.92107373 0.93272424 0.87457275
  0.89105755 0.92110777 0.92262334 0.90454364 0.9211956  0.8676886
  0.868766   0.8560817  0.8932461  0.86747396 0.8515549  0.86083496
  0.8699673  0.8615229  0.8558515  0.9050587  0.896488   0.87781113
  0.9001328  0.88985914 0.89166045 0.9030302  0.86785877 0.8812458
  0.87424564 0.8767971  0.86670774]
 [0.9164917  0.92290723 0.92869455 0.9286057  0.9099274  0.8714878
  0.8635635  0.8934799  0.86862916 0.8532107  0.8737883  0.8467739
  0.8957528  0.8964273  0.9021412  0.91366076 0.924763   0.92341226
  0.89736176 0.9076283  0.88709193 0.8994831  0.8955754  0.91340506
  0.91467154 0.90264165 0.9085073  0.9069729  0.87779063 0.92363566
  0.90646166 0.9187463  0.9038877  0.8711322  0.90456367 0.8887996
  0.92667323 0.922877   0.9179216  0.91839206 0.9215188  0.8704322
  0.88956165 0.9012356  0.8938276  0.89647853 0.91383433 0.8499301
  0.8525782  0.84535784 0.874672   0.856224   0.8408591  0.8456199
  0.85919523 0.8527504  0.8497002  0.878575   0.88480395 0.8599193
  0.894564   0.8957293  0.8760111  0.88678    0.85769117 0.88115937
  0.86909646 0.86042905 0.8651768 ]
 [0.92840123 0.93297493 0.92751336 0.93360406 0.93188643 0.8900313
  0.8756614  0.901355   0.8767604  0.8611969  0.8677004  0.86892533
  0.90546817 0.91220814 0.9255603  0.91969883 0.9343593  0.9322682
  0.90482986 0.9227742  0.8933561  0.90726393 0.90870506 0.91437554
  0.9188195  0.91057855 0.91290206 0.9103628  0.88587123 0.92976695
  0.9095218  0.9149489  0.90796167 0.8690524  0.90813226 0.89030784
  0.9263128  0.93193287 0.92519134 0.9120729  0.9286374  0.8715745
  0.89116293 0.91751575 0.9199997  0.90546215 0.91679066 0.8628763
  0.86576957 0.8525185  0.8897939  0.8642774  0.8526689  0.8565439
  0.8656607  0.8529107  0.8549661  0.89784163 0.9066583  0.88892066
  0.8984371  0.8915581  0.8954957  0.9104051  0.8723695  0.8854012
  0.87496924 0.8839191  0.8684547 ]
 [0.91203576 0.9247419  0.92651373 0.926205   0.9081656  0.87318426
  0.8629389  0.8964054  0.86981905 0.8533255  0.870632   0.8454443
  0.89555156 0.89073586 0.89759743 0.9105115  0.92366505 0.9204073
  0.89536303 0.90688753 0.8879602  0.89863527 0.89435375 0.91218126
  0.9156722  0.899127   0.90802    0.90404665 0.87613136 0.9214087
  0.9058159  0.9196225  0.9029043  0.87373996 0.9031735  0.89012456
  0.92427135 0.9206079  0.9144252  0.9134756  0.9183227  0.8683202
  0.88516974 0.90131754 0.8903162  0.8919369  0.90881866 0.84738725
  0.847996   0.8457298  0.87850773 0.8508836  0.84130394 0.8458196
  0.86211073 0.85282725 0.8520743  0.8741014  0.87667596 0.853082
  0.89329636 0.89472604 0.87378085 0.88392174 0.8498339  0.8781531
  0.8659351  0.85506    0.86127746]]

FINAL MODEL SIMILARITIES (After Training):
[[0.65346175 0.664498   0.5768176  0.63196313 0.57514787 0.6121305
  0.5872116  0.6396607  0.6045572  0.49052238 0.59715754 0.55694973
  0.6473774  0.58924425 0.56091833 0.6225022  0.642421   0.62368834
  0.57615554 0.56515    0.6277505  0.6206964  0.61341214 0.6365315
  0.6410278  0.5999005  0.643464   0.60634786 0.512965   0.61445785
  0.6913676  0.63186723 0.61679727 0.56531394 0.6090123  0.5329808
  0.62709904 0.63249266 0.61535966 0.606144   0.6212783  0.5150006
  0.5833875  0.5368717  0.5688614  0.5495109  0.6101387  0.5536151
  0.5330099  0.47228304 0.5731813  0.5048698  0.45551914 0.5259099
  0.54474163 0.50925255 0.530562   0.6391103  0.4984444  0.47333026
  0.59881103 0.5907713  0.5392975  0.5309482  0.52022463 0.5232116
  0.5201824  0.56983185 0.50799155]
 [0.6159804  0.55715775 0.554556   0.6148905  0.61544836 0.6750761
  0.6062523  0.6334791  0.60857964 0.6110332  0.5608388  0.52901775
  0.57167256 0.59959036 0.6377383  0.6100789  0.6245477  0.6237949
  0.67156565 0.6634114  0.6761081  0.65359217 0.6171381  0.6519284
  0.65620065 0.6061311  0.67963594 0.71662104 0.6175039  0.6180398
  0.58533955 0.6068168  0.56753105 0.54433984 0.6479975  0.5401174
  0.6227736  0.61200655 0.62884486 0.6027616  0.6380596  0.5713829
  0.68171304 0.57641125 0.6684468  0.5913798  0.62090945 0.5616571
  0.52822834 0.4938454  0.5827571  0.5684866  0.5166783  0.5467327
  0.52844167 0.5238378  0.49694452 0.6214249  0.56162417 0.58760345
  0.56412375 0.5512551  0.5614325  0.53682    0.5595062  0.6011094
  0.60490084 0.62024534 0.51671004]
 [0.6481785  0.63399863 0.60584044 0.6443396  0.6286338  0.66729724
  0.60010314 0.6439054  0.60389596 0.53900224 0.56807303 0.55137455
  0.6354528  0.62256294 0.63565415 0.6183419  0.646241   0.6367473
  0.6068075  0.59222865 0.6647924  0.6655015  0.6276316  0.6337487
  0.67990494 0.6511711  0.6510576  0.6294543  0.55235904 0.62368447
  0.6276127  0.6402099  0.6015629  0.55978227 0.63639665 0.51580423
  0.63389146 0.6406363  0.63177145 0.6121328  0.63797855 0.5447162
  0.6095778  0.57489324 0.614091   0.5748246  0.59951794 0.56052315
  0.5510727  0.5082025  0.6151361  0.5519145  0.5096555  0.56405056
  0.55067295 0.52903324 0.51291126 0.6187527  0.5447949  0.5417786
  0.6024318  0.56130755 0.57794523 0.5865749  0.5377944  0.5281125
  0.55904114 0.6124222  0.53905416]
 [0.61724734 0.58362    0.5851293  0.6527531  0.5905212  0.61931336
  0.5383298  0.5864104  0.56491077 0.5374924  0.55733407 0.5903081
  0.60019076 0.57681495 0.5626335  0.5884788  0.6513115  0.6351899
  0.5728472  0.5920848  0.60471046 0.58307725 0.55364645 0.6213376
  0.61060214 0.56873167 0.6127299  0.59463316 0.5606556  0.60334367
  0.65214574 0.61715853 0.5758147  0.5605911  0.580876   0.53430253
  0.6058991  0.67107105 0.58279836 0.5839286  0.5955528  0.5273297
  0.60282105 0.56214464 0.569993   0.5589926  0.5741662  0.52325094
  0.52395463 0.49703014 0.5869714  0.49947807 0.4872834  0.5458657
  0.5352727  0.5219522  0.51709676 0.6049986  0.485674   0.5010264
  0.5717714  0.55014527 0.5300298  0.5416844  0.512367   0.5608146
  0.56712204 0.5145438  0.51566315]
 [0.6634354  0.63539684 0.58656335 0.6484839  0.6440264  0.66941994
  0.5866188  0.66745555 0.59175634 0.5499846  0.5543871  0.5210016
  0.60813856 0.6305084  0.6540324  0.64177716 0.6506348  0.6373623
  0.6207149  0.64169943 0.69217515 0.6760763  0.6418357  0.64330304
  0.699601   0.62555754 0.684826   0.6555563  0.59132075 0.6494291
  0.61559665 0.6408865  0.5854517  0.53054136 0.6541364  0.5649593
  0.64871705 0.6381265  0.651311   0.6118924  0.6605774  0.5492233
  0.61897933 0.60724396 0.6720052  0.5902018  0.61315155 0.56919026
  0.5534195  0.5137162  0.61871475 0.56120443 0.50822365 0.5561023
  0.5529574  0.5361654  0.5001762  0.6501223  0.5632343  0.5652448
  0.6079629  0.55218947 0.58197856 0.5869633  0.5468554  0.54300815
  0.56031275 0.6194377  0.52249014]
 [0.6627251  0.65648925 0.6457156  0.672052   0.6190134  0.65281
  0.608274   0.6902093  0.6344532  0.5729308  0.61717236 0.52078044
  0.6292162  0.6228759  0.63419056 0.6571641  0.66294867 0.6498617
  0.6451315  0.6446049  0.7136035  0.6915411  0.6416167  0.6765454
  0.7226639  0.66046333 0.7149349  0.691202   0.5997838  0.66712695
  0.6465256  0.6904237  0.62249535 0.594998   0.6762669  0.5855521
  0.6744266  0.6538661  0.66657454 0.65516686 0.6779239  0.5873145
  0.6654366  0.59871024 0.63550776 0.61694026 0.64217603 0.56643075
  0.5555712  0.5321787  0.6133317  0.57803214 0.5267148  0.5609069
  0.5711889  0.5603361  0.5320151  0.6202547  0.5792732  0.5625327
  0.6421584  0.62056226 0.5858588  0.58923185 0.5669307  0.59333146
  0.59538066 0.62060034 0.5681659 ]
 [0.65600026 0.6438974  0.5990404  0.6439968  0.642689   0.66718197
  0.60243577 0.671439   0.6166606  0.5547129  0.5566838  0.54479724
  0.61594105 0.6278906  0.662382   0.63246596 0.6490524  0.63366586
  0.6250023  0.6476284  0.6900507  0.6724187  0.63867545 0.6363727
  0.6921937  0.6416715  0.6853093  0.65852183 0.58160263 0.64257956
  0.6128631  0.6356589  0.5919608  0.5466178  0.6441697  0.5476287
  0.6300421  0.6383128  0.645584   0.59295857 0.65644217 0.54855174
  0.6275887  0.60479224 0.6723573  0.60123914 0.6081264  0.5630716
  0.55273956 0.51149017 0.61657727 0.55992734 0.519632   0.5515546
  0.54839367 0.51898354 0.50575435 0.63641137 0.6015419  0.60633934
  0.61115134 0.5655316  0.6016813  0.61723006 0.56841457 0.5636291
  0.57070315 0.64915276 0.5358342 ]
 [0.6485318  0.661589   0.6386796  0.6641209  0.61325365 0.6577996
  0.60631335 0.6988325  0.6379236  0.5733349  0.60759616 0.51690215
  0.628284   0.6052747  0.6200001  0.647123   0.65902793 0.64014494
  0.63874006 0.64196277 0.7159326  0.68854827 0.63756967 0.6723216
  0.72524023 0.6494112  0.71295655 0.68177223 0.5946841  0.6598195
  0.64412713 0.6926249  0.6192011  0.6027138  0.6716051  0.58935785
  0.66654444 0.6463749  0.6554276  0.6398032  0.66762257 0.5809972
  0.6517451  0.5986756  0.6244659  0.60303867 0.62654305 0.55888283
  0.5420218  0.53346205 0.6247909  0.5622119  0.5282263  0.5615971
  0.5798881  0.56066966 0.53915066 0.6063226  0.55508685 0.54229593
  0.6380535  0.6173301  0.5790752  0.58053505 0.54365915 0.58424175
  0.5858443  0.6043347  0.55667055]]

CROSS-ATTENTION WEIGHTS:
[[0.2 0.2 0.2 0.2 0.2 0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0. ]
 [0.2 0.2 0.2 0.2 0.2 0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0. ]
 [0.2 0.2 0.2 0.2 0.2 0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0. ]
 [0.2 0.2 0.2 0.2 0.2 0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0. ]
 [0.2 0.2 0.2 0.2 0.2 0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0. ]
 [0.2 0.2 0.2 0.2 0.2 0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0. ]
 [0.2 0.2 0.2 0.2 0.2 0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0. ]
 [0.2 0.2 0.2 0.2 0.2 0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.
  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0. ]]

LEARNING EFFECT (Final - Raw):
[[ 6.31809235e-06 -1.95503235e-05 -1.84178352e-05 -1.85370445e-05
  -9.47713852e-06 -2.27093697e-05  1.31130219e-06  8.52346420e-06
  -1.31130219e-06  5.48362732e-06  2.03847885e-05 -6.37769699e-06
   1.60932541e-06 -1.87754631e-05 -3.45706940e-06  1.19209290e-06
  -3.81469727e-06 -3.75509262e-06 -6.55651093e-06 -8.64267349e-06
  -5.00679016e-06 -2.20537186e-05 -2.32458115e-06  1.24573708e-05
  -1.57356262e-05 -1.78813934e-05 -1.06096268e-05 -5.36441803e-06
   1.07288361e-06 -1.37686729e-05 -6.07967377e-06 -6.49690628e-06
   6.55651093e-06  1.62124634e-05  3.69548798e-06 -3.15904617e-06
   8.46385956e-06  5.96046448e-06 -8.88109207e-06  1.48415565e-05
  -2.07424164e-05 -2.74181366e-06 -5.36441803e-07 -1.84774399e-05
   2.38418579e-07 -9.65595245e-06 -1.19209290e-05 -2.44379044e-06
  -1.33514404e-05 -8.94069672e-08 -1.60932541e-05  1.66893005e-05
  -2.07126141e-05 -4.47034836e-06 -2.36034393e-05 -3.69548798e-06
  -2.15172768e-05  1.95503235e-05 -6.25848770e-06 -1.87754631e-06
  -4.47034836e-06 -3.15904617e-06  1.07288361e-05  6.25848770e-06
   4.70876694e-06 -1.79409981e-05 -1.66893005e-06 -1.78813934e-07
  -1.56760216e-05]
 [ 1.50799751e-05 -8.28504562e-06 -5.96046448e-08 -8.16583633e-06
   1.16229057e-05 -3.15904617e-06  8.76188278e-06  2.06232071e-05
   1.32322311e-05  3.93390656e-06  1.97291374e-05  8.28504562e-06
   3.81469727e-06 -1.29342079e-05  1.22785568e-05  1.17421150e-05
   5.78165054e-06  8.64267349e-06 -8.94069672e-07  2.26497650e-06
   5.36441803e-06 -2.11596489e-05  5.66244125e-06  1.54972076e-05
   8.22544098e-06 -3.39746475e-06  6.13927841e-06 -9.23871994e-06
  -4.17232513e-06 -3.03983688e-06 -5.96046448e-07  2.26497650e-06
   1.77025795e-05  1.65104866e-05  1.28149986e-05 -5.54323196e-06
   2.16960907e-05  5.42402267e-06  0.00000000e+00  1.54972076e-05
  -5.30481339e-06 -7.86781311e-06 -8.58306885e-06 -6.67572021e-06
   1.28746033e-05 -2.80141830e-06  4.17232513e-07 -1.72853470e-06
   2.26497650e-06  5.36441803e-07  2.86102295e-06  1.19209290e-05
  -1.86562538e-05  5.36441803e-07 -9.47713852e-06 -2.44379044e-06
  -1.30236149e-05  2.41398811e-05 -1.19209290e-06  4.82797623e-06
   2.98023224e-07  5.30481339e-06  1.76429749e-05  1.77025795e-05
   1.85370445e-05 -3.57627869e-06  3.81469727e-06  1.35302544e-05
  -1.20401382e-05]
 [-1.84774399e-06 -2.53319740e-05 -2.75373459e-05 -3.53455544e-05
  -1.41263008e-05 -3.15904617e-05 -9.23871994e-06 -5.96046448e-06
  -1.11460686e-05 -4.94718552e-06  4.29153442e-06 -2.18749046e-05
  -7.09295273e-06 -2.24113464e-05 -6.37769699e-06 -2.92062759e-06
  -1.77025795e-05 -2.09808350e-05 -1.32918358e-05 -1.85370445e-05
  -1.06096268e-05 -3.40342522e-05 -1.17421150e-05 -3.51667404e-06
  -1.81198120e-05 -3.12924385e-05 -1.94907188e-05 -2.58088112e-05
  -1.62124634e-05 -1.88946724e-05 -2.47955322e-05 -1.84774399e-05
   9.17911530e-06 -5.90085983e-06 -5.42402267e-06 -2.49743462e-05
  -1.19209290e-07 -1.77621841e-05 -1.29938126e-05  2.02655792e-06
  -2.28881836e-05 -2.09212303e-05 -1.96099281e-05 -2.83718109e-05
  -8.70227814e-06 -2.55107880e-05 -1.70469284e-05 -1.21593475e-05
  -1.18017197e-05 -3.75509262e-06 -3.45110893e-05 -9.53674316e-07
  -2.62260437e-05 -1.00731850e-05 -2.95639038e-05 -1.86562538e-05
  -2.51531601e-05 -4.17232513e-07 -1.16229057e-05 -1.14440918e-05
  -1.40070915e-05 -1.57356262e-05 -1.49011612e-06 -1.18017197e-05
  -3.99351120e-06 -2.59876251e-05 -1.81794167e-05 -2.08616257e-06
  -2.18153000e-05]
 [-8.34465027e-06 -2.74777412e-05 -3.09348106e-05 -2.72393227e-05
  -1.31726265e-05 -2.18749046e-05 -8.28504562e-06 -3.69548798e-06
  -1.23381615e-05 -2.98023224e-07  6.13927841e-06 -1.38878822e-05
  -6.97374344e-06 -3.46302986e-05 -1.20401382e-05 -1.90734863e-06
  -1.78217888e-05 -1.65700912e-05 -1.24573708e-05 -1.35302544e-05
  -1.40666962e-05 -3.86834145e-05 -1.27553940e-05 -3.75509262e-06
  -1.68681145e-05 -2.83122063e-05 -2.15768814e-05 -1.66296959e-05
  -1.13248825e-05 -2.22921371e-05 -1.56164169e-05 -2.07424164e-05
   7.68899918e-06 -7.98702240e-06 -3.51667404e-06 -2.31266022e-05
   9.17911530e-06 -1.15036964e-05 -1.62124634e-05  1.84774399e-06
  -2.67028809e-05 -1.77025795e-05 -1.73449516e-05 -2.86102295e-05
  -7.62939453e-06 -2.08616257e-05 -2.28881836e-05 -2.56299973e-06
  -9.53674316e-06 -4.76837158e-07 -1.71661377e-05  5.60283661e-06
  -2.24411488e-05 -1.12056732e-05 -1.94311142e-05 -1.74045563e-05
  -2.37822533e-05  6.37769699e-06 -1.88052654e-05 -5.60283661e-06
  -7.03334808e-06 -1.23977661e-05 -7.15255737e-07 -1.49011612e-06
   2.02655792e-06 -2.67028809e-05 -1.31726265e-05  2.74181366e-06
  -1.63316727e-05]
 [-4.17232513e-07 -3.48687172e-05 -2.27093697e-05 -2.96831131e-05
  -2.18153000e-05 -3.18884850e-05 -1.78813934e-06  5.18560410e-06
  -1.74045563e-05 -5.36441803e-06  1.54376030e-05 -2.45571136e-05
  -1.12056732e-05 -3.15308571e-05 -1.07288361e-05 -2.50339508e-06
  -1.36494637e-05 -1.49607658e-05 -1.29342079e-05 -2.05636024e-05
  -5.36441803e-07 -2.30669975e-05 -7.03334808e-06  8.22544098e-06
  -1.49011612e-05 -2.55703926e-05 -1.46627426e-05 -2.81929970e-05
  -9.11951065e-06 -2.05636024e-05 -2.70605087e-05 -1.70469284e-05
   2.92062759e-06 -5.36441803e-07  2.50339508e-06 -1.29938126e-05
  -2.08616257e-06 -1.49011612e-05 -1.20997429e-05 -1.49011612e-06
  -2.50935555e-05 -2.96831131e-05 -2.00271606e-05 -3.03387642e-05
  -4.41074371e-06 -2.71797180e-05 -2.47359276e-05 -1.05500221e-05
  -1.64508820e-05 -2.92062759e-06 -3.52859497e-05 -3.99351120e-06
  -2.40206718e-05 -6.13927841e-06 -3.71932983e-05 -2.12788582e-05
  -3.41534615e-05 -1.54972076e-06 -1.81794167e-05 -1.06692314e-05
  -2.03847885e-05 -2.01463699e-05 -8.34465027e-06 -4.52995300e-06
  -5.54323196e-06 -3.12924385e-05 -8.58306885e-06  4.76837158e-06
  -2.39610672e-05]
 [ 1.13248825e-05 -2.56299973e-05 -2.13980675e-05 -2.11000443e-05
  -1.34110451e-05 -1.28746033e-05  1.54972076e-06  5.90085983e-06
  -1.66893005e-06  1.02519989e-05  1.53779984e-05 -4.82797623e-06
  -8.34465027e-06 -2.78949738e-05 -3.03983688e-06 -4.05311584e-06
  -1.32918358e-05 -9.11951065e-06 -6.49690628e-06 -6.13927841e-06
  -1.43647194e-05 -3.67164612e-05 -7.39097595e-06  1.06692314e-05
  -8.94069672e-06 -2.37226486e-05 -9.65595245e-06 -1.03712082e-05
  -5.84125519e-06 -2.10404396e-05 -1.14440918e-05 -1.15633011e-05
   9.47713852e-06  6.13927841e-06  7.92741776e-06 -4.23192978e-06
   8.16583633e-06  1.37090683e-06 -1.40070915e-05  1.29342079e-05
  -2.21133232e-05 -9.89437103e-06  4.17232513e-06 -1.97887421e-05
  -1.49011612e-06 -1.00731850e-05 -7.98702240e-06 -2.80141830e-06
  -5.12599945e-06  2.80141830e-06 -1.27553940e-05  5.66244125e-06
  -1.59740448e-05  1.84774399e-06 -2.31266022e-05 -3.93390656e-06
  -1.35898590e-05  1.19209290e-05 -1.17421150e-05 -1.40070915e-05
  -1.33514404e-05 -1.18017197e-05  1.19209290e-07  1.25169754e-06
   3.75509262e-06 -1.31726265e-05  1.96695328e-06  1.43051147e-06
  -1.22785568e-05]
 [ 1.21593475e-05 -1.55568123e-05 -6.25848770e-06 -1.64508820e-05
  -5.78165054e-06 -1.24573708e-05  1.29938126e-05  1.89542770e-05
   6.37769699e-06  1.00731850e-05  2.38418579e-05 -1.54972076e-06
   5.90085983e-06 -1.47819519e-05  1.14440918e-05  1.15036964e-05
  -7.03334808e-06 -2.98023224e-06 -1.72853470e-06 -1.54972076e-06
   3.93390656e-06 -1.95503235e-05  1.49011612e-06  2.06828117e-05
  -7.09295273e-06 -1.13844872e-05 -4.23192978e-06 -5.18560410e-06
   6.31809235e-06 -1.96695328e-06 -1.50203705e-05 -3.75509262e-06
   1.03116035e-05  1.60336494e-05  9.53674316e-06 -1.40070915e-05
   1.69277191e-05 -1.13248825e-06  6.55651093e-06  1.96099281e-05
  -5.78165054e-06 -1.10864639e-05  5.96046448e-07 -1.50799751e-05
   1.26957893e-05 -3.27825546e-06 -5.48362732e-06 -4.41074371e-06
  -6.19888306e-06  1.78813934e-06 -1.06096268e-05  9.65595245e-06
  -1.77621841e-05 -1.78813934e-07 -2.19941139e-05 -7.33137131e-06
  -2.00867653e-05  2.18153000e-05 -1.07288361e-06  3.69548798e-06
  -9.29832458e-06 -7.39097595e-06  1.22785568e-05  1.01327896e-05
   1.40666962e-05 -1.68681145e-05 -2.62260437e-06  7.74860382e-06
  -6.31809235e-06]
 [ 2.89082527e-05 -1.90734863e-06 -5.72204590e-06 -9.41753387e-06
   1.13844872e-05 -4.94718552e-06  6.43730164e-06  1.97887421e-05
   4.23192978e-06  1.32322311e-05  2.04443932e-05  2.08616257e-06
   1.06692314e-05 -3.75509262e-06  1.39474869e-05  1.33514404e-05
   2.20537186e-06  6.19888306e-06 -3.45706940e-06 -2.44379044e-06
   1.01327896e-06 -1.86562538e-05  1.44243240e-05  2.77161598e-05
   6.55651093e-07 -1.18017197e-05  3.33786011e-06 -1.60932541e-06
   2.44379044e-06  2.26497650e-06  3.39746475e-06 -7.15255737e-07
   2.03847885e-05  1.97887421e-05  2.36630440e-05  4.70876694e-06
   2.66432762e-05  1.30534172e-05  1.90734863e-06  2.56896019e-05
  -6.85453415e-06 -3.99351120e-06  7.56978989e-06 -8.76188278e-06
   1.00731850e-05  6.31809235e-06  9.53674316e-07  8.82148743e-06
  -7.74860382e-07  1.24573708e-05 -1.03116035e-05  2.21133232e-05
  -1.08480453e-05  6.43730164e-06 -1.39474869e-05  6.13927841e-06
  -1.26957893e-05  2.36630440e-05 -2.38418579e-06 -2.62260437e-06
   2.02655792e-06  4.64916229e-06  1.62124634e-05  1.68085098e-05
   1.06692314e-05 -6.67572021e-06  6.55651093e-06  1.66296959e-05
   3.99351120e-06]]