Activator: GLU Activations as The Core Functions of a Vision Transformer
Paper
•
2405.15953
•
Published
•
1
Abdullah Nazhat Abdullah
Abdullah-Nazhat
AI & ML interests
Computer Vision, Natural Language Processing, Large Language Models, Foundational Vision Models, Vision Language Models, Large Multi-Modal Models
Recent Activity
updated
a model
7 days ago
Abdullah-Nazhat/Normalizer
updated
a model
7 days ago
Abdullah-Nazhat/Normalizer
updated
a model
4 months ago
Abdullah-Nazhat/NiNformer
Organizations
None yet
authored
2
papers
over 1 year ago