Activator: GLU Activations as The Core Functions of a Vision Transformer
Paper
•
2405.15953
•
Published
•
1
Abdullah Nazhat Abdullah
Abdullah-Nazhat
AI & ML interests
Computer Vision, Natural Language Processing, Large Language Models, Foundational Vision Models, Vision Language Models, Large Multi-Modal Models
Recent Activity
updated
a model
14 days ago
Abdullah-Nazhat/Lite_Mixer
published
a model
14 days ago
Abdullah-Nazhat/Lite_Mixer
updated
a model
25 days ago
Abdullah-Nazhat/Expansion_Factor_Free_TTT
Organizations
None yet
authored
a
paper
over 1 year ago
authored
a
paper
almost 2 years ago