Which of the following contributors to the Transformer model significantly influenced the development of GPT-3, particularly in the context of natural language processing and machine learning applications?

The Transformer architecture was introduced by Ashish Vaswani and colleagues in the 2017 paper “Attention Is All You Need. ” Their work on self‑attention and positional encoding created a model that could process long‑range language dependencies efficiently. GPT‑3 builds directly on this architecture, using the same attention mechanisms to learn language patterns from vast text corpora. Because Vaswani’s paper defined the core building blocks that GPT‑3 relies on, his contribution is the most significant for the model’s NLP capabilities. For example, GPT‑3 can predict the next word in a sentence by attending to all previous words, just as the Transformer model does.