向量化

简述

向量化过程是将item转换为向量的过程,其前置步骤为语法解析、成分分解、令牌化,本部分将先后介绍如何获得数据集、如何使用本地的预训练模型、如何直接调用远程提供的预训练模型。

获得数据集

概述

此部分通过调用 OpenLUNA.json 获得。

I2V

概述

使用自己提供的任一预训练模型(给出模型存放路径即可)将给定的题目文本转成向量。

  • 优点:可以使用自己的模型,另可调整训练参数,灵活性强。

D2V

导入类

[1]:
from EduNLP.I2V import D2V
D:\MySoftwares\Anaconda\envs\data\lib\site-packages\gensim\similarities\__init__.py:15: UserWarning: The gensim.similarities.levenshtein submodule is disabled, because the optional Levenshtein package <https://pypi.org/project/python-Levenshtein/> is unavailable. Install Levenhstein (e.g. `pip install python-Levenshtein`) to suppress this warning.
  warnings.warn(msg)

输入

类型:str
内容:题目文本 (text)
[2]:
items = [
r"1如图几何图形.此图由三个半圆构成,三个半圆的直径分别为直角三角形$ABC$的斜边$BC$, 直角边$AB$, $AC$.$\bigtriangleup ABC$的三边所围成的区域记为$I$,黑色部分记为$II$, 其余部分记为$III$.在整个图形中随机取一点,此点取自$I,II,III$的概率分别记为$p_1,p_2,p_3$,则$\SIFChoice$$\FigureID{1}$",
r"2如图来自古希腊数学家希波克拉底所研究的几何图形.此图由三个半圆构成,三个半圆的直径分别为直角三角形$ABC$的斜边$BC$, 直角边$AB$, $AC$.$\bigtriangleup ABC$的三边所围成的区域记为$I$,黑色部分记为$II$, 其余部分记为$III$.在整个图形中随机取一点,此点取自$I,II,III$的概率分别记为$p_1,p_2,p_3$,则$\SIFChoice$$\FigureID{1}$"
]

输出

[3]:
model_path = "./d2v/test_d2v_256.bin"
i2v = D2V("pure_text","d2v",filepath=model_path, pretrained_t2v = False)

item_vectors, token_vectors = i2v(items)
print(item_vectors[0])
print(token_vectors) # For d2v, token_vector is None
print("shape of item_vector: ",len(item_vectors), item_vectors[0].shape)
[ 0.10603202 -0.10537548 -0.04773913  0.15573525  0.25898772 -0.06423073
 -0.02817309  0.0068187  -0.07323898  0.06517941  0.07943465  0.14800762
 -0.06772996 -0.23892336  0.04638071  0.1539897   0.17565852  0.02895202
 -0.18859927  0.2180874   0.00909669  0.06621908 -0.02090263 -0.13006955
 -0.21020882  0.00618349  0.00531093 -0.04877732 -0.06709669 -0.04705636
  0.09211092  0.13896106 -0.07455818  0.06019318 -0.09071473  0.12701215
  0.13018885 -0.02784999  0.10064025 -0.07757548 -0.05522636 -0.02657779
 -0.04159601 -0.03008493  0.10995369 -0.00587291  0.05902484  0.06532726
  0.04887666  0.01902074  0.03713945  0.03691795  0.12516327  0.07410683
 -0.14467879  0.05678609  0.02574336 -0.1320522   0.07502684  0.07929367
 -0.06655917 -0.0144536   0.02595847  0.04403471  0.21743318 -0.02525017
 -0.0416184   0.21441495 -0.09308876 -0.09418222  0.08030997  0.00492512
 -0.04921608 -0.07808654 -0.03323801  0.0879296  -0.04668022 -0.0696011
  0.06708417  0.06555629 -0.07418457 -0.13050951 -0.01802611  0.11730465
 -0.0479078   0.06389603  0.12324224 -0.17746696 -0.09874132 -0.07683054
  0.06596514 -0.04210603  0.03182372 -0.1455575   0.03900012  0.13290605
 -0.07672353 -0.02826704 -0.00803517 -0.09681892 -0.15212329 -0.10524812
  0.03367848  0.10413344 -0.0089777   0.0583192  -0.01553376  0.02675472
  0.12278829  0.01667286  0.01958599 -0.06468913  0.08307286  0.07304061
 -0.10451686 -0.04367925  0.0143903   0.11394493  0.00759796 -0.03158598
 -0.01733392 -0.12918264  0.1761386  -0.02913121 -0.01364522  0.01497996
  0.09318532 -0.03958051  0.00465893 -0.01766865 -0.03531685  0.01445563
  0.05919004 -0.10480376 -0.08359206 -0.08283877 -0.04920156  0.0486405
  0.0059151  -0.03783213 -0.01815955 -0.0157437   0.2334638   0.15233137
 -0.2698607  -0.04492244  0.03728078  0.06730984  0.09165722  0.07212968
 -0.1418279  -0.10517611 -0.0469548  -0.01878718 -0.08850995  0.07481015
  0.15206474  0.0923347  -0.08849481  0.01736124  0.12647657 -0.03515046
  0.07980374 -0.06639698  0.00411603  0.0479564   0.04197159  0.0854824
  0.103918   -0.01195896  0.05059687 -0.03206704  0.0277859   0.05210226
 -0.15160614 -0.01996467 -0.00720571 -0.01154042  0.10944121 -0.00173247
  0.11439639 -0.04765575  0.05989955 -0.05265343  0.11914644  0.0085329
 -0.13220952 -0.1538407  -0.07261448  0.04143476  0.15447438  0.02005473
  0.14354227  0.10015973  0.12290012  0.05011315  0.0425972  -0.13731483
  0.02323116 -0.1031343  -0.17960383 -0.04875064  0.14352156  0.04516263
 -0.04433561  0.11548021 -0.2057457  -0.02778868 -0.06643672  0.05604808
  0.04864014 -0.03015646  0.07734285  0.00573904  0.01155302  0.02486293
  0.16259493  0.05099423 -0.15283771 -0.01909443 -0.12749314  0.06718695
  0.08334705 -0.05442797  0.03448674 -0.00542413  0.00832719  0.02702984
 -0.02359959 -0.00855793 -0.19381124 -0.13036375 -0.0351354  -0.03983364
  0.0133928   0.07395492  0.04119737  0.05661048  0.08151852 -0.1529391
  0.00742581  0.05521343  0.02089992 -0.00824985 -0.00211842 -0.05555268
  0.05448649 -0.02032894 -0.0760811  -0.01713146 -0.16146915  0.10822926
 -0.1240218  -0.03639562 -0.20028785 -0.02452293]
None
shape of item_vector:  2 (256,)

W2V

[4]:
from EduNLP.I2V import W2V
[5]:
model_path = "./w2v/general_literal_300/general_literal_300.kv"
i2v = W2V("pure_text","w2v",filepath=model_path, pretrained_t2v = False)

item_vectors, token_vectors = i2v(items)

print(item_vectors[0])
print(token_vectors[0][0])
print("shape of item_vectors: ", len(item_vectors), item_vectors[0].shape)
print("shape of token_vectors: ", len(token_vectors), len(token_vectors[0]), len(token_vectors[0][0]))
[-1.34266680e-03  5.19845746e-02 -1.98070258e-02 -4.17470075e-02
  4.92814295e-02 -1.70883536e-01 -2.16597781e-01 -3.12069029e-01
  8.96430463e-02 -1.31331667e-01  9.16494895e-03 -3.22572999e-02
  3.07940125e-01  1.92060292e-01  1.31043345e-02  6.10962026e-02
  2.21019030e-01 -3.53541046e-01  1.34150490e-01  1.14867561e-01
  1.17448963e-01  2.27990672e-01 -1.65213019e-01  2.78246611e-01
 -4.36594114e-02 -1.37816787e-01 -1.07707813e-01 -1.80805102e-01
  1.20028563e-01 -1.14409983e-01  6.19181581e-02 -1.79836392e-01
  7.68677965e-02  2.41688967e-01  6.20721914e-02 -7.59824514e-02
  1.79465964e-01  1.69306010e-01 -1.99512452e-01 -9.75036696e-02
  1.02485821e-01 -1.59723386e-01 -1.67252243e-01  1.52240042e-02
 -5.98842278e-03  6.47612512e-02  8.48228261e-02  2.67874986e-01
 -1.73656959e-02 -4.40101810e-02  9.11948457e-02  1.40905827e-01
  6.33735815e-03  2.03221604e-01 -1.97303146e-01  1.32987842e-01
 -1.80283263e-01  3.64040211e-02  2.49624569e-02  7.49479085e-02
 -2.05568615e-02 -4.02397066e-02 -1.08619891e-01 -1.04757406e-01
 -8.36341307e-02  6.61163032e-02 -1.11632387e-03  3.96131463e-02
 -3.51454802e-02  9.09155831e-02  1.87938929e-01 -2.40521863e-01
 -5.97307160e-02  1.74426511e-01  1.56350788e-02 -4.20243442e-02
 -1.90285146e-02 -3.85696471e-01 -1.01543151e-01 -1.42145246e-01
  2.33298853e-01  1.85939763e-02 -2.68633634e-01 -3.60178575e-02
  3.64447385e-02 -1.70443758e-01  1.03326524e-02 -1.47003353e-01
 -9.38110873e-02  1.63190335e-01  1.20674491e-01 -2.36976147e-02
 -6.52602538e-02  1.29773334e-01 -4.23593611e-01  2.43276700e-01
 -8.00978579e-03 -9.39133018e-03  1.17623486e-01  1.16482794e-01
 -9.27330479e-02  6.17316999e-02  1.51295820e-02  2.25901395e-01
  7.31975585e-02  2.29724105e-02  9.95925292e-02 -1.10697523e-01
  2.28960160e-02  8.65939483e-02  1.16645083e-01 -7.00058565e-02
  1.13389529e-01 -5.30471019e-02  1.43660516e-01  1.61379650e-02
  6.77419230e-02  8.09707418e-02  2.09957212e-01 -6.64654151e-02
 -1.81450248e-01  2.21659631e-01 -4.53737518e-03  4.69567403e-02
  8.59350115e-02  1.17934339e-01 -1.98988736e-01 -4.13361974e-02
  1.26167178e-01  3.84825058e-02  1.64396539e-01 -1.63344927e-02
  9.12889242e-02 -1.13650873e-01 -1.37156844e-02  2.06742659e-02
 -9.15742964e-02  7.41296187e-02  2.50813574e-01 -1.35987863e-01
 -1.11708120e-01 -1.52451068e-01  1.08608082e-01  4.99855466e-02
  1.68440521e-01 -2.47063249e-01 -2.21773341e-01  4.81536575e-02
 -7.66365305e-02  2.55189091e-01 -5.60788438e-03 -2.69066542e-02
  2.07698755e-02  1.36008840e-02  1.33086294e-01 -3.80828045e-02
 -7.03251585e-02 -6.18199483e-02  9.03518647e-02 -1.89310908e-01
 -5.30523732e-02 -2.04426926e-02 -2.27697566e-01  7.68405125e-02
  1.28568143e-01  1.07449636e-01 -1.98028013e-01 -2.67155319e-01
 -5.17064631e-02 -1.62200809e-01  1.87425911e-01  4.74511087e-02
 -4.24213745e-02 -2.71449953e-01 -2.83543557e-01 -2.36278087e-01
 -4.38764729e-02  1.67618364e-01 -2.51966029e-01 -2.73265123e-01
 -1.68406263e-01 -3.58684808e-01  2.44145632e-01 -2.55741596e-01
 -2.28520826e-01  2.39279866e-01 -1.68833986e-01  1.66422993e-01
 -3.53969544e-01 -1.10907286e-01 -6.29489049e-02 -4.55605611e-02
  1.46765754e-01  1.95176788e-02 -3.80197394e-04  3.36615089e-03
 -1.42359287e-01 -1.06109239e-01 -3.36164385e-02  3.16832401e-02
  1.09924652e-01  2.10711379e-02  1.58359021e-01  1.71957895e-01
  4.08717275e-01 -4.28679548e-02 -6.48310632e-02  1.27063962e-02
  5.73479272e-02  1.40002951e-01 -3.66613895e-01  8.07148069e-02
  2.11823225e-01 -1.10516161e-01 -2.01001287e-01  3.22122797e-02
  5.47345541e-02  2.30176803e-02 -9.94866490e-02 -4.44128877e-03
  6.64432272e-02  1.28168091e-01 -2.34743133e-01  3.17057431e-01
 -8.75139013e-02  2.66474396e-01 -3.12204093e-01  7.78969377e-03
  6.21694922e-02  7.64596611e-02 -8.79013091e-02  1.01901866e-01
  3.23867425e-02 -2.27650225e-01  9.44062844e-02 -5.54776154e-02
 -7.03687780e-03  5.66167049e-02 -1.87480077e-01  9.11692008e-02
  1.51293352e-01 -1.92774653e-01  2.23165095e-01  2.26982050e-02
 -2.70489484e-01  1.25889871e-02 -2.30410039e-01  1.40989587e-01
  2.20341813e-02  2.70313285e-02  6.07572980e-02  8.79322216e-02
  7.42911696e-02 -2.76499927e-01  2.05189809e-01 -1.84953049e-01
 -1.68468937e-01  1.85525760e-01 -3.32091609e-03  2.29632735e-01
  7.13749304e-02 -2.75445748e-02  2.74335817e-02  1.65132031e-01
 -1.64373592e-01 -1.14925921e-01  4.98081557e-02  2.10796613e-02
 -2.07561441e-02  5.90056814e-02 -1.25214513e-02  3.78197022e-02
  3.62618983e-01  1.72744930e-01 -8.75385627e-02  1.52320743e-01
  1.29331559e-01 -1.34815618e-01  6.12287596e-02  7.30569959e-02
  5.37401363e-02 -1.46815628e-01 -2.61263877e-01  2.18300954e-01
  8.95068944e-02 -6.59529120e-02 -8.52308050e-02  2.63195664e-01
  2.09921718e-01 -1.73417434e-01  2.11869497e-02  7.06950724e-02
 -7.89924189e-02  1.11086138e-01 -1.29149273e-01  1.16233543e-01
  2.16104537e-01 -3.05427730e-01 -2.46336535e-01  7.59556964e-02]
[-9.74057533e-04  1.39671087e-03 -2.67836265e-04  3.15364590e-03
  2.96666636e-04  2.81736051e-04 -2.63743475e-03  1.52303779e-03
  1.01379235e-03  1.57282199e-03 -1.71113803e-04  8.02559836e-04
  2.57097790e-03  1.81893981e-03  2.63088616e-03  3.40178027e-04
 -2.11292668e-03 -2.50976160e-03 -1.20709895e-03  1.67239667e-03
 -2.58512655e-03 -1.26207829e-03  1.39700493e-03  1.95603608e-03
  2.89038429e-03 -2.39552581e-03 -3.91247275e-04 -3.21114226e-03
  9.58531688e-04  8.29325523e-04 -1.59795280e-03  1.25081465e-03
  3.81096208e-04  1.59411912e-03 -8.54889571e-04 -3.06331483e-03
  1.97919217e-04 -9.37395904e-04  2.09570490e-03  1.22304517e-03
 -2.73981970e-03  1.85640890e-03 -8.50516954e-04  2.05107126e-03
  3.25771095e-03 -2.02651741e-03 -2.99406121e-03 -2.29128683e-03
  7.10814027e-04 -2.45556026e-03  3.29233892e-03 -1.30950764e-03
 -1.89368729e-03  1.27877074e-03  2.70718103e-03 -2.21936312e-03
  1.69272022e-03  7.79648602e-04  2.15323060e-03 -1.90569717e-03
 -2.24422058e-03 -7.12279463e-04  1.38582790e-03  2.27209576e-03
 -2.48074066e-03 -1.57340372e-03 -2.78435787e-03  2.53080134e-03
  9.29941365e-04  9.57158394e-04 -4.04856197e-04  7.77039502e-04
  2.93451315e-03  1.50868180e-03 -2.39667180e-03  1.94984837e-03
 -1.30266906e-03 -3.10783624e-03  2.75730062e-03  6.42884581e-04
 -5.66801231e-04  7.95386615e-04 -2.41047610e-03  1.00338063e-03
  2.82178726e-03 -2.43772753e-03  5.73688361e-04  1.23452744e-03
 -3.01872566e-03 -1.07384368e-03  3.28231254e-03 -5.47548116e-04
  2.18831864e-03 -3.27980524e-04  1.68147963e-03  2.44990899e-03
 -2.45229807e-03  1.02455064e-03 -2.29938584e-03  2.91304989e-03
  1.60753564e-03  1.12590473e-03  3.00752558e-03  1.44218525e-03
  3.16225761e-03 -1.64008932e-04 -5.27421653e-04  1.06547831e-03
  1.11937604e-03  4.77150286e-04 -2.42268969e-03 -3.12998053e-03
  4.55578178e-04  2.90129334e-03 -3.05265025e-03 -1.28805637e-03
 -2.08641519e-03  3.26466886e-03 -2.95106089e-03 -2.08173040e-03
 -1.99576933e-03  4.53641405e-04 -2.70907651e-03 -2.34400504e-03
  1.16086320e-03 -2.44718627e-03  9.25636268e-05  9.73496411e-04
 -1.01899146e-03 -3.02827288e-03  9.58363991e-04 -3.27257067e-03
  2.40717572e-03  1.20117664e-04  1.10580446e-03 -4.41495577e-05
 -2.85318610e-03  1.54357916e-03  3.11869616e-03  6.44255488e-04
 -1.31027703e-03 -1.52749463e-03  8.79097788e-04  7.01892364e-04
  1.34046946e-03 -8.91715696e-04 -1.93791394e-03 -4.34041809e-04
  1.12010317e-03 -2.24535773e-03 -1.76302914e-03 -1.11521804e-03
 -2.68377946e-03 -2.55486579e-03  2.67607206e-03 -2.09635729e-03
  4.45536774e-04  4.23340796e-04 -2.36946181e-03  1.01201690e-03
  2.53369007e-03 -8.69231240e-04 -2.23573043e-05  4.58726077e-04
  9.46683111e-04 -1.58690137e-03  1.31600059e-03  2.19468423e-03
 -1.69886113e-03  1.71214901e-03 -1.43307843e-04 -1.10225752e-03
  3.13180522e-03  1.78616366e-03 -4.65679186e-05 -1.40959187e-03
 -6.96717121e-04 -5.70511795e-04 -1.54102559e-03 -2.30318774e-03
  2.54784338e-03 -1.62216101e-03  3.14650533e-04 -2.94532534e-03
 -1.02099183e-03  2.99499906e-03 -6.38728146e-04 -2.72372481e-03
  3.22340080e-03 -1.49127806e-03  2.27723271e-03  2.73366761e-03
  2.62600114e-03  2.68271845e-03  3.20440996e-03 -4.97240224e-04
 -1.02938886e-03  3.26999027e-04  9.46711691e-04  1.76053529e-03
  1.74157624e-03  1.49760721e-03 -3.09546776e-05  2.48821010e-03
  2.15774146e-03  2.42709951e-03 -2.46135960e-03  1.82637456e-03
 -3.11999000e-03 -2.49591586e-03 -3.27967643e-03 -1.17016002e-03
  6.43555308e-04  3.32132494e-03 -2.58475146e-03 -7.75608991e-04
  3.30572366e-03  6.71840506e-04 -2.23828160e-04  2.99876463e-03
  3.10293835e-05 -1.25048554e-03  2.48837401e-03 -4.16146126e-04
 -8.01149989e-04 -2.19148802e-04 -2.70171487e-03  1.73141161e-04
 -2.53586681e-03  3.11773620e-03  1.13646187e-04  2.82005151e-03
 -3.23787535e-04  1.52152695e-03  3.21076158e-03 -2.29426223e-04
 -2.22376501e-03 -3.26833175e-03  5.72812569e-04  3.06089874e-03
  8.33402446e-04  1.29480439e-03  1.32911524e-03  2.61883345e-03
 -2.53178203e-03  6.48000219e-04  2.66361074e-03 -3.05172289e-03
 -9.23413434e-04 -2.13261833e-03  8.54914193e-04 -1.48963137e-03
 -1.95632223e-03 -7.69955339e-04 -3.29735363e-03  1.98830920e-03
  1.31162966e-03  1.10320176e-03 -3.22533771e-03  2.04978790e-03
 -5.25970478e-04 -1.89223525e-03  2.42309878e-03  8.27315671e-04
  9.63741913e-04  8.84156208e-04  1.02529768e-03 -1.41616585e-03
  6.75518531e-04 -6.47147477e-04  2.71809031e-03  2.17319001e-03
  9.71910951e-04 -2.93364283e-03  2.43404706e-04  1.14709849e-03
 -1.99730392e-04  3.82491737e-04 -3.08531453e-03 -2.20424891e-03
  2.87708524e-03  1.51069486e-03  9.24036489e-04 -1.09619542e-03
  1.36686012e-03 -2.61674239e-03 -1.52974128e-04 -2.72300956e-03
  1.70241436e-03 -6.61658472e-04 -2.15324806e-03 -2.46914220e-03
  1.41488796e-03 -3.25874239e-03 -2.29610526e-03 -2.22696620e-03
 -2.09132349e-03 -2.79461709e-03 -3.24834906e-03 -1.12362858e-03]
shape of item_vectors:  2 (300,)
shape of token_vectors:  2 55 300

get_pretrained_i2v

概述

使用 EduNLP 项目组给定的预训练模型将给定的题目文本转成向量。

  • 优点:简单方便。

  • 缺点:只能使用项目中给定的模型,局限性较大。

导入功能块

[6]:
from EduNLP import get_pretrained_i2v

输入

类型:str
内容:题目文本 (text)
[7]:
items = [
"如图来自古希腊数学家希波克拉底所研究的几何图形.此图由三个半圆构成,三个半圆的直径分别为直角三角形$ABC$的斜边$BC$, 直角边$AB$, $AC$.$\bigtriangleup ABC$的三边所围成的区域记为$I$,黑色部分记为$II$, 其余部分记为$III$.在整个图形中随机取一点,此点取自$I,II,III$的概率分别记为$p_1,p_2,p_3$,则$\SIFChoice$$\FigureID{1}$"
]

模型选择与使用

根据题目所属学科选择预训练模型:

预训练模型名称

模型训练数据的所属学科

d2v_all_256

全学科

d2v_sci_256

理科

d2v_eng_256

英语

d2v_lit_256

文科

w2v_eng_300

英语

w2v_lit_300

文科

[8]:
i2v = get_pretrained_i2v("d2v_sci_256", model_dir="./d2v")
EduNLP, INFO Use pretrained t2v model d2v_sci_256
downloader, INFO http://base.ustc.edu.cn/data/model_zoo/EduNLP/d2v/general_science_256.zip is saved as d2v\general_science_256.zip
downloader, INFO file existed, skipped
  • 注意: 默认的 EduNLP 项目存储地址为根目录(~/.EduNLP),模型存储地址为项目存储地址下的 model 文件夹。您可以通过修改下面的环境变量来修改模型存储地址:

    • EduNLP 项目存储地址:EDUNLPPATH = xx/xx/xx

    • 模型存储地址:EDUNLPMODELPATH = xx/xx/xx

[9]:
item_vectors, token_vectors = i2v(items)
print(item_vectors)
print(token_vectors)
[array([-0.23861311,  0.06892798, -0.27065727,  0.16547263,  0.02818857,
       -0.18185084,  0.09226187,  0.01612627,  0.0921795 ,  0.3134312 ,
        0.09265023, -0.22529641, -0.25788078,  0.06702194,  0.09765045,
       -0.19932257,  0.08527228, -0.22684543, -0.1776405 , -0.03682012,
        0.6210964 , -0.26637274,  0.08060682, -0.15860714, -0.17825642,
       -0.13271384,  0.27331072,  0.18202724,  0.08430962,  0.23299456,
        0.179898  ,  0.1571772 , -0.1406754 , -0.19508898, -0.11265783,
        0.11396482,  0.0223774 ,  0.07824919, -0.2421433 ,  0.06195279,
       -0.04763965, -0.02037446,  0.07481094, -0.1908799 ,  0.09688905,
        0.3995564 ,  0.28225863,  0.30547026, -0.46538818, -0.02891348,
       -0.19343005,  0.01966276, -0.21590087,  0.09774096, -0.26137134,
       -0.23963049,  0.34259936,  0.14825426, -0.2987728 , -0.38039675,
       -0.12087625,  0.05897354,  0.06351897,  0.10188989,  0.12092843,
        0.13229063,  0.12786968, -0.15378596,  0.00724137, -0.13644631,
       -0.15164569,  0.11535735, -0.24394232, -0.08835315,  0.05014084,
       -0.05980775,  0.03040357, -0.05804552, -0.04122322,  0.31905708,
       -0.02468318,  0.06953011, -0.1299219 ,  0.01482821, -0.00126122,
       -0.20185567, -0.00784766, -0.28023243, -0.16416278, -0.04939609,
       -0.22619021, -0.17099814,  0.1434735 , -0.13193442, -0.18329675,
       -0.06873035, -0.21638975, -0.0767743 ,  0.17778671,  0.0459166 ,
        0.0719557 ,  0.0797654 , -0.15445784, -0.20094277,  0.11860424,
        0.09521067, -0.10993416, -0.01273298, -0.0857757 , -0.05475522,
       -0.09463413,  0.00845256,  0.06638184, -0.22701578,  0.06599791,
        0.1323833 ,  0.2227748 ,  0.13431212, -0.08537175,  0.14300612,
        0.24459998,  0.00735889, -0.07123663,  0.24863936,  0.10320719,
       -0.06399037,  0.0537433 ,  0.00862593, -0.10747737, -0.01009098,
        0.01707896,  0.07951383, -0.2245529 ,  0.03152119,  0.19090259,
        0.27611575, -0.16507478,  0.05977706,  0.09740735,  0.32154247,
       -0.02540598, -0.20875612,  0.11484967,  0.12112009, -0.00937327,
       -0.03855037, -0.03728763,  0.13645649,  0.42706412,  0.14456204,
       -0.1542145 ,  0.07858715,  0.14076898,  0.01195827,  0.16896723,
       -0.0516856 ,  0.05795754,  0.09602529,  0.02058077,  0.14346235,
        0.3984762 ,  0.06770886, -0.5524451 , -0.18779868,  0.11151859,
       -0.06967582,  0.09465033,  0.2242416 , -0.17179447,  0.20837718,
        0.43269685, -0.33945957,  0.00746959, -0.14856125, -0.04883511,
        0.0790235 ,  0.18130969, -0.06500382, -0.05761597,  0.15247819,
        0.22402437,  0.33508143, -0.02544755,  0.10404763, -0.0392291 ,
        0.14048643, -0.39408255, -0.04759403, -0.09290893, -0.10062248,
        0.3836949 , -0.04212417,  0.04195033, -0.34143335,  0.02139966,
        0.00748172,  0.09670173,  0.11287135,  0.07313446, -0.06884305,
       -0.27654266, -0.02745902,  0.11782443, -0.05509072, -0.02731109,
        0.02932139,  0.20647307, -0.09912065,  0.08175386,  0.04051739,
       -0.13783188,  0.2178767 ,  0.01360986, -0.11862064,  0.02632025,
        0.01305837, -0.07418288, -0.11537156,  0.07784148, -0.02828423,
        0.0152778 , -0.27535534, -0.26457086, -0.2426946 ,  0.17839569,
        0.41153124, -0.06237097,  0.28373018,  0.09847705, -0.2693095 ,
        0.15109962,  0.02665104,  0.12224031,  0.0053689 ,  0.08057593,
        0.0029663 , -0.01309686,  0.04294159, -0.26014623, -0.09540065,
       -0.19017759, -0.02596658, -0.21918078, -0.04269371,  0.09444954,
       -0.05112423,  0.21732539,  0.2555126 ,  0.06598321, -0.00912136,
        0.01300732, -0.02216252,  0.16752972,  0.00181198,  0.02385568,
       -0.0017939 ], dtype=float32)]
None