Update README.md
Browse files
README.md
CHANGED
@@ -28,9 +28,10 @@ language:
|
|
28 |
In addition to the 14B full-scale model, a lightweight 1.7B version is available for on-device use, making it accessible on personal devices such as smartphones and PCs. VARCO-VISION-2.0 is a powerful open-source AI model built for Korean users and is freely available for a wide range of applications.
|
29 |
|
30 |
## 🚨News🎙️
|
|
|
31 |
- 📰 2025-07-28: We released VARCO-VISION-2.0-1.7B-OCR at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-1.7B-OCR)
|
32 |
- 📰 2025-07-28: We released VARCO-VISION-2.0-1.7B at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-1.7B)
|
33 |
-
-
|
34 |
- 📰 2025-07-16: We released VARCO-VISION-2.0-14B at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-14B)
|
35 |
- 📰 2025-07-16: We released GME-VARCO-VISION-Embedding at [link](https://huggingface.co/NCSOFT/GME-VARCO-VISION-Embedding)
|
36 |
|
@@ -72,13 +73,13 @@ Please note that for certain benchmarks involving LLM-based evaluation (e.g., LL
|
|
72 |
### English Benchmark
|
73 |
| Benchmark | InternVL3-14B | Ovis2-16B | Qwen2.5-VL-7B | A.X 4.0 VL Light | VARCO-VISION-2.0-14B |
|
74 |
| :-------------: | :-----------: | :-------: | :-----------: | :--------------: | :------------------: |
|
75 |
-
| MMStar | **68.9** | *67.2* | 64.1 | 56.8 | 66.
|
76 |
-
| MMMU_VAL | **64.8** | 60.7 | 58.0 | 54.1 | *61.
|
77 |
-
| MathVista | **74.4** | *73.7* | 68.1 | 62.4 | 73.
|
78 |
| OCRBench | 87.7 | *87.9* | **88.8** | 73.8 | 86.9 |
|
79 |
-
| AI2D | *86.0* | **86.3** | 84.3 | 81.0 | 85.
|
80 |
-
| HallusionBench | *55.9* | **56.8** | 51.9 | 54.2 | 53.
|
81 |
-
| MMVet | **80.5** | 68.4 | *69.7* | 59.4 |
|
82 |
| SEEDBench_IMG | 77.5 | *77.7* | 77.0 | 76.7 | **78.0** |
|
83 |
| LLaVABench | 84.4 | **93.0** | *91.0* | 83.2 | 90.2 |
|
84 |
| RealWorldQA | 69.8 | *74.1* | 68.4 | 63.4 | **74.6** |
|
@@ -269,4 +270,4 @@ generate_ids_trimmed = [
|
|
269 |
output = processor.decode(generate_ids_trimmed[0], skip_special_tokens=False)
|
270 |
print(output)
|
271 |
```
|
272 |
-
</details>
|
|
|
28 |
In addition to the 14B full-scale model, a lightweight 1.7B version is available for on-device use, making it accessible on personal devices such as smartphones and PCs. VARCO-VISION-2.0 is a powerful open-source AI model built for Korean users and is freely available for a wide range of applications.
|
29 |
|
30 |
## 🚨News🎙️
|
31 |
+
- 🛠️ 2025-08-22: We updated the checkpoint of VARCO-VISION-2.0-1.7B for improved performance.
|
32 |
- 📰 2025-07-28: We released VARCO-VISION-2.0-1.7B-OCR at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-1.7B-OCR)
|
33 |
- 📰 2025-07-28: We released VARCO-VISION-2.0-1.7B at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-1.7B)
|
34 |
+
- 🛠️ 2025-07-18: We updated the checkpoint of VARCO-VISION-2.0-14B for improved performance.
|
35 |
- 📰 2025-07-16: We released VARCO-VISION-2.0-14B at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-14B)
|
36 |
- 📰 2025-07-16: We released GME-VARCO-VISION-Embedding at [link](https://huggingface.co/NCSOFT/GME-VARCO-VISION-Embedding)
|
37 |
|
|
|
73 |
### English Benchmark
|
74 |
| Benchmark | InternVL3-14B | Ovis2-16B | Qwen2.5-VL-7B | A.X 4.0 VL Light | VARCO-VISION-2.0-14B |
|
75 |
| :-------------: | :-----------: | :-------: | :-----------: | :--------------: | :------------------: |
|
76 |
+
| MMStar | **68.9** | *67.2* | 64.1 | 56.8 | 66.9 |
|
77 |
+
| MMMU_VAL | **64.8** | 60.7 | 58.0 | 54.1 | *61.9* |
|
78 |
+
| MathVista | **74.4** | *73.7* | 68.1 | 62.4 | 73.2 |
|
79 |
| OCRBench | 87.7 | *87.9* | **88.8** | 73.8 | 86.9 |
|
80 |
+
| AI2D | *86.0* | **86.3** | 84.3 | 81.0 | 85.7 |
|
81 |
+
| HallusionBench | *55.9* | **56.8** | 51.9 | 54.2 | 53.2 |
|
82 |
+
| MMVet | **80.5** | 68.4 | *69.7* | 59.4 | 68.9 |
|
83 |
| SEEDBench_IMG | 77.5 | *77.7* | 77.0 | 76.7 | **78.0** |
|
84 |
| LLaVABench | 84.4 | **93.0** | *91.0* | 83.2 | 90.2 |
|
85 |
| RealWorldQA | 69.8 | *74.1* | 68.4 | 63.4 | **74.6** |
|
|
|
270 |
output = processor.decode(generate_ids_trimmed[0], skip_special_tokens=False)
|
271 |
print(output)
|
272 |
```
|
273 |
+
</details>
|