Skip to content
This repository has been archived by the owner on Oct 16, 2023. It is now read-only.

[FEATURE] Settings related to common layers. #39

Open
BoxiangW opened this issue May 18, 2022 · 0 comments
Open

[FEATURE] Settings related to common layers. #39

BoxiangW opened this issue May 18, 2022 · 0 comments
Labels
enhancement New feature or request

Comments

@BoxiangW
Copy link
Contributor

Describe the feature

Compared to vanilla PyTorch, Titans right now includes many unnecessary codes for example multiple files for MLP.
We could provide common MLP, Attention ... modules for users to avoid redundancy in both our repo and users' codes.
I have attached an simple example of PyTorch code as well.
image
@BoxiangW BoxiangW added the enhancement New feature or request label May 18, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@BoxiangW