📝 Softplus Function

$$-\log \sigma (t)=-\log \frac{1}{1+\exp (-t)}=\log (1+\exp (-t))$$

Is like a smoothed Version of ReLU.