Hoi / 你好 / ようこそ

👋 I’m Lester Yang. This blog is where I document my exploration of machine learning, artificial intelligence, and occasionally other things that I’m interested in.

Modern Transformers: Activations

Activation functions in modern LLM architecture

February 26, 2024 · 13 min · Lester Yang