Skip to content

Commit 9401ac4

Browse files
authored
Update README.md
1 parent 607def0 commit 9401ac4

1 file changed

Lines changed: 33 additions & 14 deletions

File tree

‎README.md‎

Lines changed: 33 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -44,6 +44,39 @@ RDM = distance.squareform(distance.pdist(feature_representations - feature_repre
4444
np.fill_diagonal(RDM,np.nan)
4545
```
4646

47+
## Results
48+
49+
### Average Variance Explained
50+
51+
![folds](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/Fig6.png)
52+
The average variance explained by the computer vision (VGG19, Densent169, MobilenetV2) and the word embedding (Fast Text, GloVe, Word2Vec) models, averaging across 27 subjects. The error-bars represent 95\% confidence interval of a bootstrapping of 1000 iterations.
53+
54+
### Difference between Computer Vision models and Word Embedding modles
55+
56+
![comparison1](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/Fig7.png)
57+
Differences between computer vision and word embedding models in variance explained. Computer vision models significantly explained more variance of the BOLD response compared to word embedding models. All one-sample t-tests against zero difference between models were significant and FDR corrected for multiple comparisons.
58+
59+
### The difference between CV and WE model contrasted between Shallow and Deep Processing conditions
60+
61+
![comparison2](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/Fig8.png)
62+
Overall difference between Word Embedding and Computer Vision models per ROI (* FDR corrected for multiple comparisons). We found that the advantage of computer vision models over word embeddings models was higher in the deep processing condition relative to the shallow processing in PCG, PHG, and POP, while the opposite pattern was observed in FFG, IPL, and ITL
63+
64+
### Number of positive voxel explained by the two models
65+
66+
![positve](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/positive%20voxels%20(high).jpeg)
67+
The number of positive variance explained voxels for computer vision models and word embedding models. ROIs are color-coded and conditions are coded in different markers.
68+
69+
![posstat](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/difference%20of%20positive%20voxels.jpeg)
70+
The difference of the number of positive variance explained voxels between computer vision models and word embedding models for each ROI and condition. *: p < 0.05, **: p < 0.01, ***: p < 0.0001.
71+
72+
### Voxel-wise scores by the two models
73+
74+
![voxelwise](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/voxel%20wise%20scores%20(high).jpeg)
75+
Variance explained of individual voxels for all ROIs and conditions. ROIs are color-coded and conditions are coded in different makers. Particularly, voxels that cannot be positively explained by either the computer vision nor the word embedding models are shown by black circles. A few (~100 voxels for all subjects, ROIs, and conditions) that have extreme negative varience explained are not shown on the figure.
76+
77+
![voxelstat](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/posterior%20probability%20of%20computer%20vision%20greater%20than%20word%20embedding%20(high).jpeg)
78+
The posterior probability of computer vision models explain more variance than the word embedding models for a given voxel in a given ROI and condition. A prior probability of computer vision models explain more variance than the word embedding models was given by Beta(2, 2). [This prior is centered at 0.5 and is lower for all other values](https://www.thomasjpfan.com/2015/09/bayesian-coin-flips/). For a given ROI and condition, a voxel is better explained by the computer vision models was labeled “1” while “0” if vis versa. The posterior probability was computed by multiplying the prior probability and the likelihood of “1”. The posterior was normalized by divided its vector norm before reporting. θ: probability of computer vision models explain more variance than the word embedding models. The dotted line represents the average of initial prior probability, which means a naive belief that computer vision and word embedding models explain the same amount of variance for a given voxel.
79+
4780
## [Word Embedding Models in Spanish](https://github.com/dccuchile/spanish-word-embeddings)
4881

4982
![basic](https://jaxenter.com/wp-content/uploads/2018/08/image-2-768x632.png)
@@ -190,18 +223,4 @@ Word vector (From [Introduction to Word Vectors](https://medium.com/@jayeshbahir
190223

191224
![mobilenetRDM](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/metasema%20word2vec%20RDM%20%28img2vec%20%28mobilenetv2_1%29.png)
192225

193-
## Results
194-
### Average Variance Explained
195-
![folds](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/Fig6.png)
196226

197-
### Difference between Computer Vision models and Word Embedding modles
198-
![comparison1](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/Fig7.png)
199-
200-
### The difference between CV and WE model contrasted between Shallow and Deep Processing conditions
201-
![comparison2](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/Fig8.png)
202-
203-
### Number of positive voxel explained by the two models
204-
![positve](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/positive%20voxels%20(high).jpeg)
205-
206-
### Voxel-wise scores by the two models
207-
![voxelwise](https://github.com/nmningmei/METASEMA_encoding_model/blob/master/figures/voxel%20wise%20scores%20(high).jpeg)

0 commit comments

Comments
 (0)