I've noticed that within the CrossAttention class (https://github.com/facebookresearch/jepa/blob/main/src/models/utils/modules.py#L137), the layer named "proj" is instantiated but it doesn't appear to be utilized within the forward method.
Is it a oversight?
I've noticed that within the CrossAttention class (https://github.com/facebookresearch/jepa/blob/main/src/models/utils/modules.py#L137), the layer named "proj" is instantiated but it doesn't appear to be utilized within the forward method.
Is it a oversight?