GloVe: Global Vectors for Word Representation

GloVe

• GloVe = Global + Vectors
• [Highlights] GloVe가 잘 capture하는 것들!

Details

• global log-bilinear regression model
• global matrix factorization의 장점 + local context window methods의 장점
• co-occurence statistics
• 추정해야 하는 $F$
• training only on the nonzero elements in a word-word co-occurence matrix

➕

• ✏️
• 💬
• 📝