NLP Deep Learning LLMs Intermediate Demo content

Embedding

التضمين (المتجه الدلالي)

Definition

Representing an object (a word, sentence or image) as a vector of real numbers in a multidimensional space, so that objects with similar meanings lie close together.

Definition

An embedding is a learned dense vector representation of an object (a token, sentence, image, etc.) in a continuous space where semantic similarity corresponds to geometric closeness.

Mathematical equations

\cos(\mathbf{u},\mathbf{v}) = \frac{\mathbf{u}\cdot\mathbf{v}}{\lVert\mathbf{u}\rVert\,\lVert\mathbf{v}\rVert}

Scientific sources

References and scientific sources

Learn and review

Suggested terms to learn next