Chenhao Tan University of Chicago @ChenhaoTan, @chenhaotan.bsky.social chenhao@uchicago.edu
Power-law distributions in empirical data. Aaron Clauset, Cosma Rohilla Shalizi, M. E. J. Newman.
庄子 (Zhuangzi), Chapter 5
[photo credit: Jaron Collis on Quora]
Skip-gram: Predict context words from center word
CBOW (Continuous Bag of Words): Predict center from context
Levy & Goldberg (2014)