lesterpjy's blog
Archive
Search
Tags
Home
Posts
Modern Transformers, Part 1: Activations
Activation functions in modern LLM architecture