tirank.Model.PositionalEncoding

class tirank.Model.PositionalEncoding(*args: Any, **kwargs: Any)[source]

Bases: Module

PositionalEncoding module for Transformer.

Injects sinusoidal positional encodings to the input embeddings.

Parameters:

d_model (int) – The embedding dimension.
dropout (float, optional) – Dropout value. Defaults to 0.1.
max_len (int, optional) – The maximum length of the input sequences. Defaults to 5000.

forward(x)[source]

Forward pass for PositionalEncoding.

Parameters:: x (torch.Tensor) – Input tensor.
Returns:: Output tensor with added positional encoding.
Return type:: torch.Tensor