This book describes the functions frequently used in deep neural networks. For thispurpose, 37 activation functions are explained both mathematically and visually, andgiven with their LaTeX implementations due to their common use in scientific articles.