merve PRO
merve
AI & ML interests
I love this website
VLMs, vision & co
Recent Activity
liked
a Space
about 9 hours ago
prithivMLmods/Qwen-Image-Diffusion
updated
a dataset
about 14 hours ago
huggingface/documentation-images
posted
an
update
about 14 hours ago
massive releases and tons of Flux 1. Krea LoRas past week!
here's some of the picks, find more models in collection 🫡 https://huggingface.co/collections/merve/releases-august-2-6890c14248203522b7d0267f
LLMs 💬
> Tencent dropped https://huggingface.co/tencent/Hunyuan-7B-Instruct
> Qwen released https://huggingface.co/Qwen/Qwen3-Coder-30B-A3B-Instruct, 30B MoE with 3B params for coding (OS)
vision/multimodal
> RedNote released https://huggingface.co/rednote-hilab/dots.ocr - 3B OCR model (OS)
> Cohere released https://huggingface.co/CohereLabs/command-a-vision-07-2025 - 112B (dense!) VLM for 6 languages
> StepFun-AI shipped https://huggingface.co/stepfun-ai/step3 - 321B MoE VLM (OS)
> Skywork shipped https://huggingface.co/Skywork/Skywork-UniPic-1.5B - new any-to-any model (image+text → image+text) (OS)
Organizations
All the releases of the week of 30th May.
A collection of DSE models for multimodal retrieval
Models and datasets of the second week of Jan 2025.
-
ibm-granite/granite-3.0-8b-instruct
Text Generation • 8B • Updated • 23.4k • 202 -
ibm-granite/granite-3.0-2b-instruct
Text Generation • 3B • Updated • 4.25k • 46 -
CohereLabs/aya-expanse-8b
Text Generation • 8B • Updated • 14.6k • • 390 -
CohereLabs/aya-expanse-32b
Text Generation • 32B • Updated • 6.54k • • 266
Recent depth models
Collection of useful computer vision backbones to fine-tune. It also includes large image classification models, that can be used as backbone.
-
microsoft/resnet-50
Image Classification • 0.0B • Updated • 151k • • 431 -
google/vit-base-patch16-224-in21k
Image Feature Extraction • 0.1B • Updated • 3.13M • 360 -
google/vit-base-patch32-224-in21k
Image Feature Extraction • 0.1B • Updated • 7.87k • 19 -
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 960k • 88
-
facebook/detr-resnet-50
Object Detection • 0.0B • Updated • 412k • • 879 -
facebook/detr-resnet-101-dc5
Object Detection • 0.1B • Updated • 5.86k • 19 -
facebook/detr-resnet-50-dc5
Object Detection • 0.0B • Updated • 1.65k • 6 -
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 134k • 135
This is a collection for models that can be used for zero-shot image classification.
-
openai/clip-vit-large-patch14
Zero-Shot Image Classification • 0.4B • Updated • 11.2M • 1.82k -
openai/clip-vit-base-patch32
Zero-Shot Image Classification • Updated • 17.4M • 732 -
laion/CLIP-ViT-bigG-14-laion2B-39B-b160k
Zero-Shot Image Classification • Updated • 1.17M • 285 -
kakaobrain/align-base
Zero-Shot Image Classification • Updated • 31.2k • 26
-
microsoft/xclip-base-patch32
Video Classification • 0.2B • Updated • 251k • 96 -
facebook/timesformer-base-finetuned-k400
Video Classification • Updated • 22.1k • 42 -
facebook/timesformer-base-finetuned-k600
Video Classification • Updated • 10.1k • 12 -
google/vivit-b-16x2
Video Classification • Updated • 459 • 11
This collection contains models and demos of SAM and it's smaller friends.
A collection dedicated to SigLIP applications
-
71
Draw To Search Art
🐠Draw/upload image and search among WikiART using SigLIP
-
22
Compare Clip Siglip
🏃Compare strong zero-shot image classification models
-
13
Multilingual Zero Shot Image Clf
🏢Comparing powerful multilingual zero-shot image clf models
-
BAAI/bunny-phi-2-siglip-lora
Text Generation • Updated • 21 • 48
A collection of everything SegGPT.
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 134k • 135 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 7.22k • 12 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 45.1k • 25 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 67.9k • 27
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 134k • 135 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 7.22k • 12 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 45.1k • 25 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 67.9k • 27
A collection of video-language models
-
21
Video Llava
🐨Generate descriptions by uploading images or videos
-
llava-hf/LLaVA-NeXT-Video-7B-hf
Video-Text-to-Text • 7B • Updated • 70.6k • 105 -
llava-hf/LLaVA-NeXT-Video-7B-DPO-hf
Video-Text-to-Text • 7B • Updated • 1.74k • 9 -
llava-hf/LLaVA-NeXT-Video-7B-32K-hf
Image-Text-to-Text • 8B • Updated • 826 • 7
-
moonshotai/Kimi-VL-A3B-Thinking
Image-Text-to-Text • 16B • Updated • 99.3k • 433 -
agentica-org/DeepCoder-14B-Preview
Text Generation • 15B • Updated • 32.3k • • 669 -
HiDream-ai/HiDream-I1-Full
Text-to-Image • Updated • 253k • • 952 -
OpenGVLab/InternVL3-78B
Image-Text-to-Text • 78B • Updated • 106k • 211
-
NVLM: Open Frontier-Class Multimodal LLMs
Paper • 2409.11402 • Published • 75 -
BRAVE: Broadening the visual encoding of vision-language models
Paper • 2404.07204 • Published • 19 -
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Paper • 2403.18814 • Published • 48 -
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper • 2409.17146 • Published • 122
Models mentioned in https://huggingface.co/papers/2404.07204
-
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 960k • 88 -
google/flan-t5-xl
3B • Updated • 296k • 513 -
google/siglip-large-patch16-384
Zero-Shot Image Classification • 0.7B • Updated • 21.3k • 9 -
google/vit-huge-patch14-224-in21k
Image Feature Extraction • 0.6B • Updated • 29.2k • 21
-
facebook/deit-base-distilled-patch16-384
Image Classification • 0.1B • Updated • 1.42k • 5 -
facebook/convnextv2-base-1k-224
Image Classification • 0.1B • Updated • 606 • • 3 -
facebook/deit-base-distilled-patch16-224
Image Classification • Updated • 15.2k • • 27 -
google/vit-base-patch32-384
Image Classification • 0.1B • Updated • 3.66k • • 23
A collection of instance/semantic/panoptic segmentation models.
-
facebook/maskformer-swin-large-coco
Image Segmentation • 0.2B • Updated • 86.2k • • 26 -
nvidia/segformer-b0-finetuned-ade-512-512
Image Segmentation • 0.0B • Updated • 280k • • 163 -
facebook/detr-resnet-50-dc5-panoptic
Image Segmentation • 0.0B • Updated • 106 • • 3 -
nvidia/segformer-b5-finetuned-cityscapes-1024-1024
Image Segmentation • Updated • 143k • • 30
Collection of image to image editing, image enhancement (SR, deblur, brighten) and text-to-image adapter models.
This collection contains image captioning and OCR models.
-
Salesforce/blip-image-captioning-large
Image-to-Text • 0.5B • Updated • 1.65M • 1.38k -
Salesforce/blip-image-captioning-base
Image-to-Text • Updated • 1.96M • 763 -
microsoft/trocr-base-handwritten
Image-to-Text • 0.3B • Updated • 562k • 424 -
microsoft/git-large-coco
Image-to-Text • 0.4B • Updated • 3.19k • 104
Foundation models for computer vision.
Models and applications of OWL-ViT and OWLv2.
A collection of open-source document AI 📄 📝 📈
Papers about vision-language models, most important ones are on top of the list.
-
Improved Baselines with Visual Instruction Tuning
Paper • 2310.03744 • Published • 38 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper • 2403.05525 • Published • 47 -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper • 2308.12966 • Published • 9 -
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Paper • 2404.01331 • Published • 28
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 134k • 135 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 7.22k • 12 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 45.1k • 25 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 67.9k • 27
A comprehensive collection on DAv2
This collection has all the vision language leaderboards.
All the models and demos for SAM2
All the releases of the week of 30th May.
A collection of DSE models for multimodal retrieval
-
moonshotai/Kimi-VL-A3B-Thinking
Image-Text-to-Text • 16B • Updated • 99.3k • 433 -
agentica-org/DeepCoder-14B-Preview
Text Generation • 15B • Updated • 32.3k • • 669 -
HiDream-ai/HiDream-I1-Full
Text-to-Image • Updated • 253k • • 952 -
OpenGVLab/InternVL3-78B
Image-Text-to-Text • 78B • Updated • 106k • 211
Models and datasets of the second week of Jan 2025.
-
NVLM: Open Frontier-Class Multimodal LLMs
Paper • 2409.11402 • Published • 75 -
BRAVE: Broadening the visual encoding of vision-language models
Paper • 2404.07204 • Published • 19 -
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Paper • 2403.18814 • Published • 48 -
Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models
Paper • 2409.17146 • Published • 122
-
ibm-granite/granite-3.0-8b-instruct
Text Generation • 8B • Updated • 23.4k • 202 -
ibm-granite/granite-3.0-2b-instruct
Text Generation • 3B • Updated • 4.25k • 46 -
CohereLabs/aya-expanse-8b
Text Generation • 8B • Updated • 14.6k • • 390 -
CohereLabs/aya-expanse-32b
Text Generation • 32B • Updated • 6.54k • • 266
Recent depth models
Models mentioned in https://huggingface.co/papers/2404.07204
-
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 960k • 88 -
google/flan-t5-xl
3B • Updated • 296k • 513 -
google/siglip-large-patch16-384
Zero-Shot Image Classification • 0.7B • Updated • 21.3k • 9 -
google/vit-huge-patch14-224-in21k
Image Feature Extraction • 0.6B • Updated • 29.2k • 21
Collection of useful computer vision backbones to fine-tune. It also includes large image classification models, that can be used as backbone.
-
microsoft/resnet-50
Image Classification • 0.0B • Updated • 151k • • 431 -
google/vit-base-patch16-224-in21k
Image Feature Extraction • 0.1B • Updated • 3.13M • 360 -
google/vit-base-patch32-224-in21k
Image Feature Extraction • 0.1B • Updated • 7.87k • 19 -
facebook/dinov2-large
Image Feature Extraction • 0.3B • Updated • 960k • 88
-
facebook/deit-base-distilled-patch16-384
Image Classification • 0.1B • Updated • 1.42k • 5 -
facebook/convnextv2-base-1k-224
Image Classification • 0.1B • Updated • 606 • • 3 -
facebook/deit-base-distilled-patch16-224
Image Classification • Updated • 15.2k • • 27 -
google/vit-base-patch32-384
Image Classification • 0.1B • Updated • 3.66k • • 23
-
facebook/detr-resnet-50
Object Detection • 0.0B • Updated • 412k • • 879 -
facebook/detr-resnet-101-dc5
Object Detection • 0.1B • Updated • 5.86k • 19 -
facebook/detr-resnet-50-dc5
Object Detection • 0.0B • Updated • 1.65k • 6 -
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 134k • 135
A collection of instance/semantic/panoptic segmentation models.
-
facebook/maskformer-swin-large-coco
Image Segmentation • 0.2B • Updated • 86.2k • • 26 -
nvidia/segformer-b0-finetuned-ade-512-512
Image Segmentation • 0.0B • Updated • 280k • • 163 -
facebook/detr-resnet-50-dc5-panoptic
Image Segmentation • 0.0B • Updated • 106 • • 3 -
nvidia/segformer-b5-finetuned-cityscapes-1024-1024
Image Segmentation • Updated • 143k • • 30
This is a collection for models that can be used for zero-shot image classification.
-
openai/clip-vit-large-patch14
Zero-Shot Image Classification • 0.4B • Updated • 11.2M • 1.82k -
openai/clip-vit-base-patch32
Zero-Shot Image Classification • Updated • 17.4M • 732 -
laion/CLIP-ViT-bigG-14-laion2B-39B-b160k
Zero-Shot Image Classification • Updated • 1.17M • 285 -
kakaobrain/align-base
Zero-Shot Image Classification • Updated • 31.2k • 26
Collection of image to image editing, image enhancement (SR, deblur, brighten) and text-to-image adapter models.
-
microsoft/xclip-base-patch32
Video Classification • 0.2B • Updated • 251k • 96 -
facebook/timesformer-base-finetuned-k400
Video Classification • Updated • 22.1k • 42 -
facebook/timesformer-base-finetuned-k600
Video Classification • Updated • 10.1k • 12 -
google/vivit-b-16x2
Video Classification • Updated • 459 • 11
This collection contains image captioning and OCR models.
-
Salesforce/blip-image-captioning-large
Image-to-Text • 0.5B • Updated • 1.65M • 1.38k -
Salesforce/blip-image-captioning-base
Image-to-Text • Updated • 1.96M • 763 -
microsoft/trocr-base-handwritten
Image-to-Text • 0.3B • Updated • 562k • 424 -
microsoft/git-large-coco
Image-to-Text • 0.4B • Updated • 3.19k • 104
Foundation models for computer vision.
This collection contains models and demos of SAM and it's smaller friends.
Models and applications of OWL-ViT and OWLv2.
A collection dedicated to SigLIP applications
-
71
Draw To Search Art
🐠Draw/upload image and search among WikiART using SigLIP
-
22
Compare Clip Siglip
🏃Compare strong zero-shot image classification models
-
13
Multilingual Zero Shot Image Clf
🏢Comparing powerful multilingual zero-shot image clf models
-
BAAI/bunny-phi-2-siglip-lora
Text Generation • Updated • 21 • 48
A collection of open-source document AI 📄 📝 📈
A collection of everything SegGPT.
Papers about vision-language models, most important ones are on top of the list.
-
Improved Baselines with Visual Instruction Tuning
Paper • 2310.03744 • Published • 38 -
DeepSeek-VL: Towards Real-World Vision-Language Understanding
Paper • 2403.05525 • Published • 47 -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper • 2308.12966 • Published • 9 -
LLaVA-Gemma: Accelerating Multimodal Foundation Models with a Compact Language Model
Paper • 2404.01331 • Published • 28
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 134k • 135 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 7.22k • 12 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 45.1k • 25 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 67.9k • 27
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 134k • 135 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 7.22k • 12 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 45.1k • 25 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 67.9k • 27
-
google/owlvit-base-patch32
Zero-Shot Object Detection • 0.2B • Updated • 134k • 135 -
google/owlvit-base-patch16
Zero-Shot Object Detection • Updated • 7.22k • 12 -
google/owlvit-large-patch14
Zero-Shot Object Detection • Updated • 45.1k • 25 -
google/owlv2-base-patch16
Zero-Shot Object Detection • 0.2B • Updated • 67.9k • 27
A comprehensive collection on DAv2
This collection has all the vision language leaderboards.
A collection of video-language models
-
21
Video Llava
🐨Generate descriptions by uploading images or videos
-
llava-hf/LLaVA-NeXT-Video-7B-hf
Video-Text-to-Text • 7B • Updated • 70.6k • 105 -
llava-hf/LLaVA-NeXT-Video-7B-DPO-hf
Video-Text-to-Text • 7B • Updated • 1.74k • 9 -
llava-hf/LLaVA-NeXT-Video-7B-32K-hf
Image-Text-to-Text • 8B • Updated • 826 • 7
All the models and demos for SAM2