Two Variants

Skip-gram: Predict context words from center word

  • Input: center word
  • Output: context words

CBOW (Continuous Bag of Words): Predict center from context

  • Input: context words
  • Output: center word