Turning words into numbers that capture meaning
orig. “Efficient Estimation of Word Representations in Vector Space” · Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean
This paper showed you can turn words into lists of numbers where "king minus man plus woman" lands near "queen".
Computers need numbers, not words. Word2Vec learns to place each word at a point in space so that words used in similar ways sit close together. A surprising result was that simple arithmetic on these points captured real relationships, like capital cities to their countries. It learned all of this just by reading lots of text and predicting nearby words.
Turning words into meaningful numbers, called embeddings, became a building block for nearly all language AI that followed. The same idea now applies to images, products, and papers. It is one of the most practical ideas a newcomer can pick up early.
Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean, Google
We write original plain-language summaries and link to the source. We never republish the paper.
Paste it and we'll explain it even more simply.
Pass all three to earn the “read & understood” stamp (+10 pts).
Pass quizzes and leave notes to climb your chapter's board. No chapters are running yet, so this one is wide open.
Start a chapter to compete →