Text is modeled through "vectorization": a text is treated as a sequence of words, and each such sequence is represented by a vector in the space spanned by the available vocabulary. The GPT algorithm "simply" predicts word
n+1 based on words 1 through
n. This could be done using very conventional models, such as Markov chains, which model transitions from one state to another (see
Tangente SUP 69, 2013). But GPT can generate very high-quality content by enhancing these elementary algorithms with a few techniques. First, the sheer quantity of data used allows neural networks to be trained more effectively:
GPT-3 was trained on 570 GB of text and has 175 billion parameters. Second, ChatGPT incorporates reinforcement learning: the texts it produces are assessed by humans, who identify the "best" ones, allowing the parameters that produced those texts to be favored. Finally, ChatGPT uses a particular neural-network architecture: transformers.