kd.nn.AttentionModule#
- class kauldron.modules.AttentionModule(*args, **kwargs)[source]
Bases:
ProtocolInterface specification for Attention modules.
Can be used as type-annotation to specify the interface of a sub-module.
Examples include: MHDPAttention, ImprovedMHDPAttention.
- num_heads: int