Does Matlab Text Analytics toolbox contain the Fasttext Pre-trained word vectors from Common Crawl (600B tokens)
2 Ansichten (letzte 30 Tage)
Ältere Kommentare anzeigen
Tesha Babka
am 30 Sep. 2018
Beantwortet: MathWorks Text Analytics Toolbox Team
am 16 Apr. 2020
Does Matlab Text Analytics toolbox contain the Fasttext pre-trained word vectors from Common Crawl (600B tokens)? It seems to have pertained vectors from a 16billion token data set from fastext. I am wondering if it has the Common Crawl (6000B tokens) Pre-trained word vectors, or if there is a Matlab scrip the add this to the Matlab word embedding model. The vectors are here https://fasttext.cc/docs/en/english-vectors.html
Actually just a Matlab script that would read the Common Crawl 600B file and output a the vectors and string of the corresponding words would be sufficient.
Thanks in advance!
0 Kommentare
Antworten (1)
MathWorks Text Analytics Toolbox Team
am 16 Apr. 2020
Text Analytics Toolbox does not itself include this embedding, but you can download it (as you said in your question) and load it into MATLAB as follows:
>> emb = readWordEmbedding("crawl-300d-2M.vec.zip")
emb =
wordEmbedding with properties:
Dimension: 300
Vocabulary: [1×1999995 string]
0 Kommentare
Siehe auch
Kategorien
Mehr zu Characters and Strings finden Sie in Help Center und File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!