Hi there! 👋

I’m Lester Yang. This blog is where I document my exploration of machine learning, artificial intelligence, and occasionally other things that I’m interested in.

Modern Transformers: Activations

Activation functions in modern LLM architecture

February 26, 2024 Â· 13 min Â· Lester Yang