codelion commited on
Commit
2ed7978
·
verified ·
1 Parent(s): 770bdfb

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: codelion/gemma-3-1b-it-ICM-DPO
3
+ tags:
4
+ - text-generation-inference
5
+ - transformers
6
+ - unsloth
7
+ - gemma3_text
8
+ - mlx
9
+ - mlx-my-repo
10
+ license: apache-2.0
11
+ language:
12
+ - en
13
+ ---
14
+
15
+ # codelion/gemma-3-1b-it-ICM-DPO-mlx-fp16
16
+
17
+ The Model [codelion/gemma-3-1b-it-ICM-DPO-mlx-fp16](https://huggingface.co/codelion/gemma-3-1b-it-ICM-DPO-mlx-fp16) was converted to MLX format from [codelion/gemma-3-1b-it-ICM-DPO](https://huggingface.co/codelion/gemma-3-1b-it-ICM-DPO) using mlx-lm version **0.25.3**.
18
+
19
+ ## Use with mlx
20
+
21
+ ```bash
22
+ pip install mlx-lm
23
+ ```
24
+
25
+ ```python
26
+ from mlx_lm import load, generate
27
+
28
+ model, tokenizer = load("codelion/gemma-3-1b-it-ICM-DPO-mlx-fp16")
29
+
30
+ prompt="hello"
31
+
32
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
33
+ messages = [{"role": "user", "content": prompt}]
34
+ prompt = tokenizer.apply_chat_template(
35
+ messages, tokenize=False, add_generation_prompt=True
36
+ )
37
+
38
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
39
+ ```