=== cell 2 stdout downloaded questions-words.txt === cell 4 stdout : capital-common-countries Athens Greece Baghdad Iraq Athens Greece Bangkok Thailand Athens Greece Beijing China Athens Greece Berlin Germany Athens Greece Bern Switzerland Athens Greece Cairo Egypt Athens Greece Canberra Australia Athens Greece Hanoi Vietnam Athens Greece Havana Cuba === cell 5 stdout 19544 questions === cell 7 result Question Category SubCategory 0 Athens Greece Baghdad Iraq Semantic : capital-common-countries 1 Athens Greece Bangkok Thailand Semantic : capital-common-countries 2 Athens Greece Beijing China Semantic : capital-common-countries 3 Athens Greece Berlin Germany Semantic : capital-common-countries 4 Athens Greece Bern Switzerland Semantic : capital-common-countries === cell 12 stdout The Gensim model loaded successfully! === cell 13 stdout OOV questions: 0 === cell 14 stdout Category: Semantic, Accuracy: 65.3399481339497% Category: Syntactic, Accuracy: 61.255269320843084% Sub-Category: capital-common-countries, Accuracy: 93.87351778656127% Sub-Category: capital-world, Accuracy: 88.94783377541998% Sub-Category: currency, Accuracy: 14.203233256351039% Sub-Category: city-in-state, Accuracy: 30.806647750304013% Sub-Category: family, Accuracy: 81.62055335968378% Sub-Category: gram1-adjective-to-adverb, Accuracy: 24.39516129032258% Sub-Category: gram2-opposite, Accuracy: 20.073891625615765% Sub-Category: gram3-comparative, Accuracy: 79.12912912912913% Sub-Category: gram4-superlative, Accuracy: 54.278074866310156% Sub-Category: gram5-present-participle, Accuracy: 69.50757575757575% Sub-Category: gram6-nationality-adjective, Accuracy: 87.86741713570981% Sub-Category: gram7-past-tense, Accuracy: 55.44871794871795% Sub-Category: gram8-plural, Accuracy: 71.996996996997% Sub-Category: gram9-plural-verbs, Accuracy: 58.39080459770115% === cell 15 [image final_cell15_0.png] === cell 15 result
=== cell 18 stdout data\wiki_texts_part_0.txt.gz 1.51 GB data\wiki_texts_part_1.txt.gz 0.84 GB data\wiki_texts_part_2.txt.gz 0.67 GB data\wiki_texts_part_3.txt.gz 0.60 GB data\wiki_texts_part_4.txt.gz 0.57 GB data\wiki_texts_part_5.txt.gz 0.58 GB data\wiki_texts_part_6.txt.gz 0.56 GB data\wiki_texts_part_7.txt.gz 0.53 GB data\wiki_texts_part_8.txt.gz 0.55 GB data\wiki_texts_part_9.txt.gz 0.55 GB data\wiki_texts_part_10.txt.gz 0.00 GB === cell 19 stdout all parts downloaded === cell 20 stdout 11 parts: ['wiki_texts_part_0.txt.gz', 'wiki_texts_part_1.txt.gz', 'wiki_texts_part_2.txt.gz', 'wiki_texts_part_3.txt.gz', 'wiki_texts_part_4.txt.gz', 'wiki_texts_part_5.txt.gz', 'wiki_texts_part_6.txt.gz', 'wiki_texts_part_7.txt.gz', 'wiki_texts_part_8.txt.gz', 'wiki_texts_part_9.txt.gz', 'wiki_texts_part_10.txt.gz'] === cell 21 stdout total compressed size: 6.93 GB === cell 22 stdout 0 anarchism is political philosophy and movement that is against all forms of authority and seeks to abolish the institutions it claims maintain unnecessary coercion and hierarchy typically including th ... 1 albedo change in greenland the map shows the difference between the amount of sunlight greenland reflected in the summer of versus the average percent it reflected between and some areas reflect close ... 2 or is the first letter and the first vowel letter of the latin alphabet used in the modern english alphabet and others worldwide its name in english is pronounced plural aes it is similar in shape to ... 3 alabama is state in the southeastern region of the united states it borders tennessee to the north georgia to the east florida and the gulf of mexico to the south and mississippi to the west alabama i ... 4 in greek mythology achilles or achilleus was hero of the trojan war who was known as being the greatest of all the greek warriors the central character in homer iliad he was the son of the nereid thet ... 5 abraham lincoln february april was an american lawyer politician and statesman who served as the th president of the united states from until his assassination in he led the united states through the ... 6 aristotle aristotélēs bc was an ancient greek philosopher and polymath his writings cover broad range of subjects spanning the natural sciences philosophy linguistics economics politics psychology and ... 7 an american in paris is jazz influenced symphonic poem or tone poem for orchestra by american composer george gershwin first performed in it was inspired by the time that gershwin had spent in paris a ... 8 the academy award for best production design recognizes achievement for art direction in film the category original name was best art direction but was changed to its current name in for the th academ ... 9 the academy awards of merit commonly known as the oscars or academy awards are awards for artistic and technical merit given for excellence within the american and international film industry they are ... === cell 24 stdout articles: total 5,623,655, sampled 1,124,733 (20.00%) wiki_sampled_5.txt 1.04 GB wiki_sampled_10.txt 2.08 GB wiki_sampled_20.txt 4.16 GB === cell 25 stdout 20% wiki tokens after preprocessing: 666,053,126 === cell 25 stdout trained on wiki_sampled_20_clean.txt: 36.9 min, vocab 299,405 === cell 27 stdout OOV questions: 0 Category: Semantic, Accuracy: 55.59815086255496% Category: Syntactic, Accuracy: 42.21077283372365% Sub-Category: capital-common-countries, Accuracy: 73.71541501976284% Sub-Category: capital-world, Accuracy: 71.3527851458886% Sub-Category: currency, Accuracy: 9.815242494226329% Sub-Category: city-in-state, Accuracy: 35.22496959870288% Sub-Category: family, Accuracy: 74.30830039525692% Sub-Category: gram1-adjective-to-adverb, Accuracy: 16.733870967741936% Sub-Category: gram2-opposite, Accuracy: 16.25615763546798% Sub-Category: gram3-comparative, Accuracy: 54.87987987987988% Sub-Category: gram4-superlative, Accuracy: 25.40106951871658% Sub-Category: gram5-present-participle, Accuracy: 33.04924242424242% Sub-Category: gram6-nationality-adjective, Accuracy: 81.05065666041276% Sub-Category: gram7-past-tense, Accuracy: 41.28205128205128% Sub-Category: gram8-plural, Accuracy: 41.14114114114114% Sub-Category: gram9-plural-verbs, Accuracy: 40.804597701149426% === cell 28 [image final_cell28_0.png] === cell 28 result
=== cell 31 stdout GloVe (pre-trained): overall 63.11% (OOV questions 0) === cell 31 stdout Wiki 20%: overall 48.29% (OOV questions 0) === cell 32 stdout keys: ['RelComments', 'RelQuestion', 'THREAD_SEQUENCE'] | question keys: ['RELQ_DATE', 'RELQ_ID', 'RelQSubject', 'RELQ_USERNAME', 'RELQ_USERID', 'RelQBody', 'RELQ_CATEGORY'] subject: Thailand:IT Minsitry blocks CNN; Facebook; first comment: have they blocked porn??? === cell 33 stdout forum: 189,941 threads, 2,118,254 posts, 72,919,300 tokens === cell 33 stdout 5% wiki tokens: 166,194,401 === cell 33 stdout wiki control: 72,920,923 tokens === cell 34 stdout trained on forum_clean.txt: 3.9 min, vocab 100,310 === cell 34 stdout trained on wiki_control_clean.txt: 4.2 min, vocab 224,050 === cell 34 stdout Forum (same size): overall 26.05% (OOV questions 3510) === cell 34 stdout Wiki control (same size): overall 41.66% (OOV questions 169) === cell 34 result Wiki control (same size) Forum (same size) \ Overall 41.66 26.05 Semantic 46.07 12.37 Syntactic 38.00 37.41 : capital-common-countries 77.47 34.78 : capital-world 54.47 12.00 : currency 7.39 1.04 : city-in-state 34.29 2.51 : family 63.24 60.67 : gram1-adjective-to-adverb 11.19 12.80 : gram2-opposite 9.73 14.04 : gram3-comparative 53.45 65.54 : gram4-superlative 19.25 43.58 : gram5-present-participle 31.16 52.18 : gram6-nationality-adjective 75.48 22.01 : gram7-past-tense 41.22 35.38 : gram8-plural 34.31 40.02 : gram9-plural-verbs 34.71 46.32 OOV questions 169.00 3510.00 Wiki 20% Overall 48.29 Semantic 55.60 Syntactic 42.21 : capital-common-countries 73.72 : capital-world 71.35 : currency 9.82 : city-in-state 35.22 : family 74.31 : gram1-adjective-to-adverb 16.73 : gram2-opposite 16.26 : gram3-comparative 54.88 : gram4-superlative 25.40 : gram5-present-participle 33.05 : gram6-nationality-adjective 81.05 : gram7-past-tense 41.28 : gram8-plural 41.14 : gram9-plural-verbs 40.80 OOV questions 0.00 === cell 34 result coverage: wiki control coverage: forum SubCategory : capital-common-countries 100.0 100.0 : capital-world 98.3 48.6 : currency 86.8 39.0 : city-in-state 100.0 68.3 : family 100.0 91.3 : gram1-adjective-to-adverb 100.0 100.0 : gram2-opposite 100.0 100.0 : gram3-comparative 100.0 100.0 : gram4-superlative 94.1 100.0 : gram5-present-participle 100.0 100.0 : gram6-nationality-adjective 100.0 95.1 : gram7-past-tense 100.0 100.0 : gram8-plural 100.0 100.0 : gram9-plural-verbs 100.0 100.0 === cell 35 result word corpus \ 0 visa Wiki control (same size) 1 visa Forum (same size) 2 salary Wiki control (same size) 3 salary Forum (same size) 4 doha Wiki control (same size) 5 doha Forum (same size) 6 family Wiki control (same size) 7 family Forum (same size) 8 king Wiki control (same size) 9 king Forum (same size) 10 paris Wiki control (same size) 11 paris Forum (same size) 12 computer Wiki control (same size) 13 computer Forum (same size) top 5 0 visas, passport, bdtc, passports, zwartendijk 1 rp, iqama, viza, residence, residance 2 salaries, repayment, pay, wages, paid 3 slary, salry, sallary, salery, salaray 4 manama, abbasiyyin, qatar, dubai, shaab 5 qatar, doah, qata, maseeid, alkhore 6 relatives, father, families, mother, grandfather 7 familly, rescidence, fmaily, pernament, famliy 8 prince, queen, monarch, harthacnut, harefoot 9 edshel, koil, ypsilanti, edsel, bhumibol 10 brussels, marseille, fontainebleau, universell... 11 amsterdam, france, cancun, london, tokyo 12 computers, software, mainframe, hardware, comp... 13 soundcard, desktop, hardware, pc, computers === cell 37 stdout 10% wiki tokens: 333,052,711 === cell 37 stdout trained on wiki_sampled_5_clean.txt: 9.1 min, vocab 278,954 === cell 37 stdout Wiki 5%: overall 45.22% (OOV questions 107) === cell 37 stdout trained on wiki_sampled_10_clean.txt: 18.4 min, vocab 294,612 === cell 37 stdout Wiki 10%: overall 46.87% (OOV questions 0) === cell 37 result Wiki 5% Wiki 10% Wiki 20% Overall 45.22 46.87 48.29 Semantic 53.93 54.26 55.60 Syntactic 37.99 40.74 42.21 : capital-common-countries 79.25 75.69 73.72 : capital-world 67.68 69.65 71.35 : currency 7.16 9.01 9.82 : city-in-state 37.21 33.44 35.22 : family 67.19 74.11 74.31 : gram1-adjective-to-adverb 13.21 10.69 16.73 : gram2-opposite 10.96 14.66 16.26 : gram3-comparative 43.09 51.13 54.88 : gram4-superlative 16.76 22.82 25.40 : gram5-present-participle 29.73 35.32 33.05 : gram6-nationality-adjective 76.99 75.98 81.05 : gram7-past-tense 44.87 44.68 41.28 : gram8-plural 37.24 41.14 41.14 : gram9-plural-verbs 38.16 40.69 40.80 OOV questions 107.00 0.00 0.00 === cell 39 result word model \ 0 king GloVe (pre-trained) 1 king Wiki 20% 2 cat GloVe (pre-trained) 3 cat Wiki 20% 4 apple GloVe (pre-trained) 5 apple Wiki 20% 6 bank GloVe (pre-trained) 7 bank Wiki 20% 8 good GloVe (pre-trained) 9 good Wiki 20% 10 taiwan GloVe (pre-trained) 11 taiwan Wiki 20% 12 computer GloVe (pre-trained) 13 computer Wiki 20% top 5 (similarity) 0 prince (0.77), queen (0.75), son (0.70), brother (0.70), monarch (0.70) 1 nangklao (0.74), prince (0.74), queen (0.72), suriyothai (0.72), throne (0.72) 2 dog (0.88), rabbit (0.74), cats (0.73), monkey (0.73), pet (0.72) 3 dog (0.74), rabbit (0.74), pet (0.72), sourpuss (0.71), mouse (0.71) 4 microsoft (0.74), ibm (0.68), intel (0.68), software (0.68), dell (0.67) 5 blackberry (0.77), iphone (0.70), tvos (0.68), raspberry (0.67), xelibri (0.66) 6 banks (0.81), banking (0.75), credit (0.70), investment (0.69), financial (0.68) 7 savings (0.74), bancorp (0.72), guaranty (0.71), dfcu (0.70), bancorporation (0.70) 8 better (0.89), sure (0.83), really (0.83), kind (0.83), very (0.83) 9 sure (0.74), bad (0.73), tough (0.72), better (0.72), decent (0.71) 10 mainland (0.86), china (0.83), taiwanese (0.79), taipei (0.79), hong (0.77) 11 china (0.85), guangdong (0.80), taipei (0.80), hainan (0.80), japan (0.78) 12 computers (0.88), software (0.84), technology (0.76), pc (0.74), hardware (0.73) 13 computers (0.82), software (0.81), computing (0.81), mainframe (0.79), hardware (0.76) === cell 41 result top-1 top-3 top-5 top-10 GloVe (pre-trained) 63.11 73.68 77.73 82.01 Wiki 20% 48.29 62.27 67.01 72.77 === cell 42 stdout wrong answers: 10107 of 19544 OOV (question word not in vocab): 0 gold answer was 2nd-10th: 4785 : capital-world === cell 42 result Question gold pred rank 508 Abuja Nigeria Amman Jordan jordan kuwait NaN 510 Abuja Nigeria Antananarivo Madagascar madagascar senegal 8.0 513 Abuja Nigeria Asmara Eritrea eritrea indonesia 5.0 518 Abuja Nigeria Bamako Mali mali faso NaN 526 Abuja Nigeria Bern Switzerland switzerland aarau 2.0 527 Abuja Nigeria Bishkek Kyrgyzstan kyrgyzstan tajikistan 2.0 === cell 42 stdout : currency === cell 42 result Question gold pred rank 5030 Algeria dinar Angola kwanza kwanza banknote NaN 5032 Algeria dinar Armenia dram dram hryvnia NaN 5033 Algeria dinar Brazil real real peso NaN 5034 Algeria dinar Bulgaria lev lev hryvnia NaN 5035 Algeria dinar Cambodia riel riel kyat NaN 5036 Algeria dinar Canada dollar dollar toonie NaN === cell 42 stdout : family === cell 42 result Question gold pred rank 8363 boy girl brother sister sister cousin 4.0 8366 boy girl father mother mother stepmother 2.0 8376 boy girl nephew niece niece cousin 8.0 8381 boy girl stepbrother stepsister stepsister stepmother 5.0 8382 boy girl stepfather stepmother stepmother husband 2.0 8391 brother sister groom bride bride bridesmaid 2.0 === cell 42 stdout : gram3-comparative === cell 42 result Question gold pred rank 10673 bad worse big bigger bigger sooner 2.0 10677 bad worse cool cooler cooler better 6.0 10686 bad worse hot hotter hotter peaking NaN 10687 bad worse large larger larger smaller 2.0 10688 bad worse long longer longer shorter 4.0 10690 bad worse low lower lower higher NaN === cell 42 stdout : gram6-nationality-adjective === cell 42 result Question gold pred \ 14183 Albania Albanian Argentina Argentinean argentinean argentinian 14186 Albania Albanian Belarus Belorussian belorussian belarusian 14192 Albania Albanian Colombia Colombian colombian honduran 14201 Albania Albanian India Indian indian oriya 14217 Albania Albanian Slovakia Slovakian slovakian slovak 14224 Argentina Argentinean Belarus Belorussian belorussian belarusian rank 14183 8.0 14186 NaN 14192 2.0 14201 4.0 14217 5.0 14224 NaN === cell 42 stdout : gram8-plural === cell 42 result Question gold pred rank 17342 banana bananas bird birds birds waterfowl 7.0 17344 banana bananas building buildings buildings renovating 2.0 17345 banana bananas car cars cars truck 2.0 17346 banana bananas cat cats cats rabbits 5.0 17347 banana bananas child children children abusers NaN 17348 banana bananas cloud clouds clouds lidar NaN === cell 43 stdout questions containing a stop word: 206 SubCategory : family 86 : gram1-adjective-to-adverb 62 : currency 58 Name: count, dtype: int64 ['Algeria dinar Korea won', 'Angola kwanza Korea won', 'Argentina peso Korea won', 'Armenia dram Korea won', 'Brazil real Korea won'] === cell 43 stdout trained on wiki_sampled_5_nostop.txt: 6.8 min, vocab 278,810 === cell 43 stdout Wiki 5% (stop words removed): overall 45.03% (OOV questions 284) === cell 43 result Wiki 5% Wiki 5% (stop words removed) Overall 45.22 45.03 Semantic 53.93 54.59 Syntactic 37.99 37.09 : capital-common-countries 79.25 81.82 : capital-world 67.68 70.73 : currency 7.16 7.27 : city-in-state 37.21 36.93 : family 67.19 50.20 : gram1-adjective-to-adverb 13.21 12.90 : gram2-opposite 10.96 8.62 : gram3-comparative 43.09 37.46 : gram4-superlative 16.76 16.40 : gram5-present-participle 29.73 31.63 : gram6-nationality-adjective 76.99 82.05 : gram7-past-tense 44.87 40.64 : gram8-plural 37.24 42.27 : gram9-plural-verbs 38.16 27.01 OOV questions 107.00 284.00 === cell 44 stdout Wiki 5% CBOW (sg=0): trained in 9.6 min === cell 44 stdout Wiki 5% CBOW (sg=0): overall 52.71% (OOV questions 107) === cell 44 stdout Wiki 5% window=10: trained in 15.1 min === cell 44 stdout Wiki 5% window=10: overall 41.86% (OOV questions 107) === cell 44 stdout Wiki 5% vector_size=300: trained in 16.6 min === cell 44 stdout Wiki 5% vector_size=300: overall 56.95% (OOV questions 107) === cell 44 result Wiki 5% Wiki 5% CBOW (sg=0) \ Overall 45.22 52.71 Semantic 53.93 59.16 Syntactic 37.99 47.34 : capital-common-countries 79.25 80.04 : capital-world 67.68 73.21 : currency 7.16 8.08 : city-in-state 37.21 43.17 : family 67.19 78.06 : gram1-adjective-to-adverb 13.21 19.05 : gram2-opposite 10.96 11.95 : gram3-comparative 43.09 68.09 : gram4-superlative 16.76 36.54 : gram5-present-participle 29.73 40.72 : gram6-nationality-adjective 76.99 76.30 : gram7-past-tense 44.87 46.47 : gram8-plural 37.24 50.15 : gram9-plural-verbs 38.16 46.90 OOV questions 107.00 107.00 Wiki 5% window=10 Wiki 5% vector_size=300 Overall 41.86 56.95 Semantic 50.70 68.16 Syntactic 34.51 47.63 : capital-common-countries 75.89 94.47 : capital-world 66.20 80.37 : currency 7.62 8.31 : city-in-state 31.41 59.30 : family 54.74 78.26 : gram1-adjective-to-adverb 13.10 13.21 : gram2-opposite 8.00 15.39 : gram3-comparative 33.56 59.53 : gram4-superlative 10.25 26.92 : gram5-present-participle 27.46 37.31 : gram6-nationality-adjective 79.80 86.74 : gram7-past-tense 36.03 49.10 : gram8-plural 36.26 54.80 : gram9-plural-verbs 36.32 52.53 OOV questions 107.00 107.00 === cell 45 stdout Wiki 20% (3CosMul): overall 44.61% (OOV questions 0) === cell 45 result Wiki 20% Wiki 20% (3CosMul) Overall 48.29 44.61 Semantic 55.60 52.54 Syntactic 42.21 38.02 : capital-common-countries 73.72 73.32 : capital-world 71.35 67.04 : currency 9.82 9.58 : city-in-state 35.22 32.83 : family 74.31 71.74 : gram1-adjective-to-adverb 16.73 12.30 : gram2-opposite 16.26 11.82 : gram3-comparative 54.88 49.85 : gram4-superlative 25.40 23.71 : gram5-present-participle 33.05 26.70 : gram6-nationality-adjective 81.05 77.42 : gram7-past-tense 41.28 37.69 : gram8-plural 41.14 35.06 : gram9-plural-verbs 40.80 38.62 OOV questions 0.00 0.00 === cell 46 [image final_cell46_0.png] === cell 47 result GloVe Wiki 20% SubCategory : capital-common-countries 100.0 100.0 : capital-world 100.0 100.0 : currency 100.0 100.0 : city-in-state 100.0 100.0 : family 100.0 100.0 : gram1-adjective-to-adverb 100.0 100.0 : gram2-opposite 100.0 100.0 : gram3-comparative 100.0 100.0 : gram4-superlative 100.0 100.0 : gram5-present-participle 100.0 100.0 : gram6-nationality-adjective 100.0 100.0 : gram7-past-tense 100.0 100.0 : gram8-plural 100.0 100.0 : gram9-plural-verbs 100.0 100.0 === cell 49 result GloVe (pre-trained) Wiki 20% \ Overall 63.11 48.29 Semantic 65.34 55.60 Syntactic 61.26 42.21 : capital-common-countries 93.87 73.72 : capital-world 88.95 71.35 : currency 14.20 9.82 : city-in-state 30.81 35.22 : family 81.62 74.31 : gram1-adjective-to-adverb 24.40 16.73 : gram2-opposite 20.07 16.26 : gram3-comparative 79.13 54.88 : gram4-superlative 54.28 25.40 : gram5-present-participle 69.51 33.05 : gram6-nationality-adjective 87.87 81.05 : gram7-past-tense 55.45 41.28 : gram8-plural 72.00 41.14 : gram9-plural-verbs 58.39 40.80 OOV questions 0.00 0.00 Forum (same size) Wiki control (same size) \ Overall 26.05 41.66 Semantic 12.37 46.07 Syntactic 37.41 38.00 : capital-common-countries 34.78 77.47 : capital-world 12.00 54.47 : currency 1.04 7.39 : city-in-state 2.51 34.29 : family 60.67 63.24 : gram1-adjective-to-adverb 12.80 11.19 : gram2-opposite 14.04 9.73 : gram3-comparative 65.54 53.45 : gram4-superlative 43.58 19.25 : gram5-present-participle 52.18 31.16 : gram6-nationality-adjective 22.01 75.48 : gram7-past-tense 35.38 41.22 : gram8-plural 40.02 34.31 : gram9-plural-verbs 46.32 34.71 OOV questions 3510.00 169.00 Wiki 5% Wiki 10% \ Overall 45.22 46.87 Semantic 53.93 54.26 Syntactic 37.99 40.74 : capital-common-countries 79.25 75.69 : capital-world 67.68 69.65 : currency 7.16 9.01 : city-in-state 37.21 33.44 : family 67.19 74.11 : gram1-adjective-to-adverb 13.21 10.69 : gram2-opposite 10.96 14.66 : gram3-comparative 43.09 51.13 : gram4-superlative 16.76 22.82 : gram5-present-participle 29.73 35.32 : gram6-nationality-adjective 76.99 75.98 : gram7-past-tense 44.87 44.68 : gram8-plural 37.24 41.14 : gram9-plural-verbs 38.16 40.69 OOV questions 107.00 0.00 Wiki 5% (stop words removed) \ Overall 45.03 Semantic 54.59 Syntactic 37.09 : capital-common-countries 81.82 : capital-world 70.73 : currency 7.27 : city-in-state 36.93 : family 50.20 : gram1-adjective-to-adverb 12.90 : gram2-opposite 8.62 : gram3-comparative 37.46 : gram4-superlative 16.40 : gram5-present-participle 31.63 : gram6-nationality-adjective 82.05 : gram7-past-tense 40.64 : gram8-plural 42.27 : gram9-plural-verbs 27.01 OOV questions 284.00 Wiki 5% CBOW (sg=0) Wiki 5% window=10 \ Overall 52.71 41.86 Semantic 59.16 50.70 Syntactic 47.34 34.51 : capital-common-countries 80.04 75.89 : capital-world 73.21 66.20 : currency 8.08 7.62 : city-in-state 43.17 31.41 : family 78.06 54.74 : gram1-adjective-to-adverb 19.05 13.10 : gram2-opposite 11.95 8.00 : gram3-comparative 68.09 33.56 : gram4-superlative 36.54 10.25 : gram5-present-participle 40.72 27.46 : gram6-nationality-adjective 76.30 79.80 : gram7-past-tense 46.47 36.03 : gram8-plural 50.15 36.26 : gram9-plural-verbs 46.90 36.32 OOV questions 107.00 107.00 Wiki 5% vector_size=300 Wiki 20% (3CosMul) Overall 56.95 44.61 Semantic 68.16 52.54 Syntactic 47.63 38.02 : capital-common-countries 94.47 73.32 : capital-world 80.37 67.04 : currency 8.31 9.58 : city-in-state 59.30 32.83 : family 78.26 71.74 : gram1-adjective-to-adverb 13.21 12.30 : gram2-opposite 15.39 11.82 : gram3-comparative 59.53 49.85 : gram4-superlative 26.92 23.71 : gram5-present-participle 37.31 26.70 : gram6-nationality-adjective 86.74 77.42 : gram7-past-tense 49.10 37.69 : gram8-plural 54.80 35.06 : gram9-plural-verbs 52.53 38.62 OOV questions 107.00 0.00 === cell 51 stdout Python 3.12.3 (tags/v3.12.3:f6650f9, Apr 9 2024, 14:05:25) [MSC v.1938 64 bit (AMD64)] Windows-11-10.0.26200-SP0 | Intel64 Family 6 Model 141 Stepping 1, GenuineIntel gensim 4.4.0 | numpy 2.5.3 | pandas 3.0.6 | scikit-learn 1.9.1