Home » Tags

Transformers

Modern Transformers: Activations

Activation functions in modern LLM architecture

February 26, 2024 · 13 min · Lester Yang