Large Language Model
نموذج لغة كبير
Definition
A huge language model, usually built on the Transformer, trained on vast amounts of text to predict the next token, through which it gained abilities in understanding, generation and reasoning.
Definition
A large language model is a neural language model, usually a Transformer with billions of parameters, pre-trained on very large text corpora to predict the next token and then often fine-tuned to follow instructions.
Scientific sources
References and scientific sources
-
Research paperLanguage Models are Few-Shot Learners The GPT-3 model and few-shot in-context learning.
-
Research paperAttention Is All You Need The paper that introduced the Transformer architecture.
-
Research paperTraining language models to follow instructions with human feedback Tuning models to follow instructions with human feedback (RLHF).
