SwiGLUMML

class keras_mml.layers.activations.SwiGLUMML[source]

Swish with \(\beta = 1\) (i.e., Sigmoid Linear Unit (SiLU)) activated Gated Linear Unit (GLU) without matrix multiplications.

See GLUMML for the full documentation.

__init__(*args, **kwargs)[source]

Initializes a new instance of the layer.

Parameters:
  • *args – Arguments to be passed into GLUMML.

  • **kwargs – Keyword arguments to be passed into GLUMML.