Which architecture forms the foundation of modern Large Language Models?
- CNN
- RNN
- Transformer
- LSTM
Answer: Transformer
Transformer architecture uses self-attention mechanisms to process sequences in parallel, enabling scaling to billions of parameters.