keras_mml.layers.transformerΒΆ

Transformer-related layers implemented by Keras-MML.

Classes

AttentionMML

Multi-headed attention layer that is mostly without matrix multiplications.

TransformerBlockMML

Transformer block layer that is mostly without matrix multiplications.