teras.activations module

glu(logits[, axis])	Generalized linear unit nonlinear activation.
geglu(logits[, axis])	GeGLU is an activation function which is a variant of GLU
gumbel_softmax(logits[, temperature, hard, seed])	Implementation of the Gumbel Softmax activation function proposed by Eric Jang et al. in the paper Categorical Reparameterization with Gumbel-Softmax.
sparsemax(logits[, axis])	Sparsemax activation function as proposed by T.