technology medium mcq

Which component enables Transformers to focus on relevant parts of input sequences?

  1. Attention Mechanism
  2. Feed-Forward Networks
  3. Positional Encoding
  4. Layer Normalization

Answer: Attention Mechanism

Self-attention computes weighted relationships between tokens, enabling context-aware processing. Foundation of Transformer success.

Topic AI/ML Advanced: Transformers
Exam Relevance UPSC, Banking, SSC

More Technology Questions