kd.nn.AttentionModule#

class kauldron.modules.AttentionModule(*args, **kwargs)[source]

Bases: Protocol

Interface specification for Attention modules.

Can be used as type-annotation to specify the interface of a sub-module.

Examples include: MHDPAttention, ImprovedMHDPAttention.