Sequence Mixer¤
discretax.sequence_mixers.base.AbstractSequenceMixer
¤
Abstract base class for all sequence mixers.
This class is used to define the interface for all sequence mixers.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
in_features
|
int
|
Input dimensionality. |
required |
key
|
PRNGKeyArray
|
JAX random key for initialization. |
required |
*args
|
Additional arguments for the sequence mixer. |
required | |
**kwargs
|
Additional keyword arguments for the sequence mixer. |
required |
__init__(in_features: int, key: PRNGKeyArray, *args, **kwargs)
¤
Initialize the sequence mixer.
__call__(x: Array, key: PRNGKeyArray) -> Array
¤
Forward pass of the sequence mixer.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
x
|
Array
|
The input sequence to the sequence mixer. |
required |
key
|
PRNGKeyArray
|
The random key for the sequence mixer. |
required |
Returns:
| Type | Description |
|---|---|
Array
|
The output of the sequence mixer. |