teras.activations.geglu# teras.activations.geglu(logits, axis=-1)[source]# GeGLU is an activation function which is a variant of GLU Parameters: logits – Tensor, tensor of logits. axis (int) – int, axis along which to apply geglu activation. Defaults to -1.
