lesterpjy's blog

Archive
Search
Tags

Transformers

Modern Transformers, Part 1: Activations

Activation functions in modern LLM architecture

February 26, 2024 · 13 min · Lester Yang

© 2024 Lester Yang Powered by Hugo & PaperMod