Prior to this recipe, we have not considered the order of words to be relevant in creating word embeddings. In early 2013, Tomas Mikolov and other researchers at Google authored a paper about creating word embeddings that addressed this issue (https://arxiv.org/abs/1301.3781), and they named their method word2vec.
The basic idea is to create word embeddings that capture the relational aspect of words. We seek to understand how various words are related to each other. Some examples of how these embeddings might behave are as follows:
king - man + woman = queen
India pale ale - hops + malt = stout
We might achieve such a numerical representation of words if we only consider their positional relationship to each other. If we could ...
