kimyoungjune commited on
Commit
3a7cc6f
·
verified ·
1 Parent(s): a6d9af8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -8
README.md CHANGED
@@ -28,9 +28,10 @@ language:
28
  In addition to the 14B full-scale model, a lightweight 1.7B version is available for on-device use, making it accessible on personal devices such as smartphones and PCs. VARCO-VISION-2.0 is a powerful open-source AI model built for Korean users and is freely available for a wide range of applications.
29
 
30
  ## 🚨News🎙️
 
31
  - 📰 2025-07-28: We released VARCO-VISION-2.0-1.7B-OCR at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-1.7B-OCR)
32
  - 📰 2025-07-28: We released VARCO-VISION-2.0-1.7B at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-1.7B)
33
- - 📰 2025-07-18: We updated the checkpoint of VARCO-VISION-2.0-14B for improved performance.
34
  - 📰 2025-07-16: We released VARCO-VISION-2.0-14B at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-14B)
35
  - 📰 2025-07-16: We released GME-VARCO-VISION-Embedding at [link](https://huggingface.co/NCSOFT/GME-VARCO-VISION-Embedding)
36
 
@@ -72,13 +73,13 @@ Please note that for certain benchmarks involving LLM-based evaluation (e.g., LL
72
  ### English Benchmark
73
  | Benchmark | InternVL3-14B | Ovis2-16B | Qwen2.5-VL-7B | A.X 4.0 VL Light | VARCO-VISION-2.0-14B |
74
  | :-------------: | :-----------: | :-------: | :-----------: | :--------------: | :------------------: |
75
- | MMStar | **68.9** | *67.2* | 64.1 | 56.8 | 66.5 |
76
- | MMMU_VAL | **64.8** | 60.7 | 58.0 | 54.1 | *61.8* |
77
- | MathVista | **74.4** | *73.7* | 68.1 | 62.4 | 73.3 |
78
  | OCRBench | 87.7 | *87.9* | **88.8** | 73.8 | 86.9 |
79
- | AI2D | *86.0* | **86.3** | 84.3 | 81.0 | 85.8 |
80
- | HallusionBench | *55.9* | **56.8** | 51.9 | 54.2 | 53.7 |
81
- | MMVet | **80.5** | 68.4 | *69.7* | 59.4 | 69.4 |
82
  | SEEDBench_IMG | 77.5 | *77.7* | 77.0 | 76.7 | **78.0** |
83
  | LLaVABench | 84.4 | **93.0** | *91.0* | 83.2 | 90.2 |
84
  | RealWorldQA | 69.8 | *74.1* | 68.4 | 63.4 | **74.6** |
@@ -269,4 +270,4 @@ generate_ids_trimmed = [
269
  output = processor.decode(generate_ids_trimmed[0], skip_special_tokens=False)
270
  print(output)
271
  ```
272
- </details>
 
28
  In addition to the 14B full-scale model, a lightweight 1.7B version is available for on-device use, making it accessible on personal devices such as smartphones and PCs. VARCO-VISION-2.0 is a powerful open-source AI model built for Korean users and is freely available for a wide range of applications.
29
 
30
  ## 🚨News🎙️
31
+ - 🛠️ 2025-08-22: We updated the checkpoint of VARCO-VISION-2.0-1.7B for improved performance.
32
  - 📰 2025-07-28: We released VARCO-VISION-2.0-1.7B-OCR at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-1.7B-OCR)
33
  - 📰 2025-07-28: We released VARCO-VISION-2.0-1.7B at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-1.7B)
34
+ - 🛠️ 2025-07-18: We updated the checkpoint of VARCO-VISION-2.0-14B for improved performance.
35
  - 📰 2025-07-16: We released VARCO-VISION-2.0-14B at [link](https://huggingface.co/NCSOFT/VARCO-VISION-2.0-14B)
36
  - 📰 2025-07-16: We released GME-VARCO-VISION-Embedding at [link](https://huggingface.co/NCSOFT/GME-VARCO-VISION-Embedding)
37
 
 
73
  ### English Benchmark
74
  | Benchmark | InternVL3-14B | Ovis2-16B | Qwen2.5-VL-7B | A.X 4.0 VL Light | VARCO-VISION-2.0-14B |
75
  | :-------------: | :-----------: | :-------: | :-----------: | :--------------: | :------------------: |
76
+ | MMStar | **68.9** | *67.2* | 64.1 | 56.8 | 66.9 |
77
+ | MMMU_VAL | **64.8** | 60.7 | 58.0 | 54.1 | *61.9* |
78
+ | MathVista | **74.4** | *73.7* | 68.1 | 62.4 | 73.2 |
79
  | OCRBench | 87.7 | *87.9* | **88.8** | 73.8 | 86.9 |
80
+ | AI2D | *86.0* | **86.3** | 84.3 | 81.0 | 85.7 |
81
+ | HallusionBench | *55.9* | **56.8** | 51.9 | 54.2 | 53.2 |
82
+ | MMVet | **80.5** | 68.4 | *69.7* | 59.4 | 68.9 |
83
  | SEEDBench_IMG | 77.5 | *77.7* | 77.0 | 76.7 | **78.0** |
84
  | LLaVABench | 84.4 | **93.0** | *91.0* | 83.2 | 90.2 |
85
  | RealWorldQA | 69.8 | *74.1* | 68.4 | 63.4 | **74.6** |
 
270
  output = processor.decode(generate_ids_trimmed[0], skip_special_tokens=False)
271
  print(output)
272
  ```
273
+ </details>