Skip to content

Commit eadd3d4

Browse files
authored
chore(model gallery): add baidu_ernie-4.5-21b-a3b-thinking (#6267)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent 2a18206 commit eadd3d4

File tree

1 file changed

+26
-0
lines changed

1 file changed

+26
-0
lines changed

gallery/index.yaml

Lines changed: 26 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,30 @@
11
---
2+
- &ernie
3+
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
4+
name: "baidu_ernie-4.5-21b-a3b-thinking"
5+
license: apache-2.0
6+
tags:
7+
- gguf
8+
- GPU
9+
- CPU
10+
- text-to-text
11+
icon: https://cdn-avatars.huggingface.co/v1/production/uploads/64f187a2cc1c03340ac30498/TYYUxK8xD1AxExFMWqbZD.png
12+
urls:
13+
- https://huggingface.co/baidu/ERNIE-4.5-21B-A3B-Thinking
14+
- https://huggingface.co/bartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF
15+
description: |
16+
Over the past three months, we have continued to scale the thinking capability of ERNIE-4.5-21B-A3B, improving both the quality and depth of reasoning, thereby advancing the competitiveness of ERNIE lightweight models in complex reasoning tasks. We are pleased to introduce ERNIE-4.5-21B-A3B-Thinking, featuring the following key enhancements:
17+
Significantly improved performance on reasoning tasks, including logical reasoning, mathematics, science, coding, text generation, and academic benchmarks that typically require human expertise.
18+
Efficient tool usage capabilities.
19+
Enhanced 128K long-context understanding capabilities.
20+
Note: This version has an increased thinking length. We strongly recommend its use in highly complex reasoning tasks. ERNIE-4.5-21B-A3B-Thinking is a text MoE post-trained model, with 21B total parameters and 3B activated parameters for each token.
21+
overrides:
22+
parameters:
23+
model: baidu_ERNIE-4.5-21B-A3B-Thinking-Q4_K_M.gguf
24+
files:
25+
- filename: baidu_ERNIE-4.5-21B-A3B-Thinking-Q4_K_M.gguf
26+
sha256: f309f225c413324c585e74ce28c55e76dec25340156374551d39707fc2966840
27+
uri: huggingface://bartowski/baidu_ERNIE-4.5-21B-A3B-Thinking-GGUF/baidu_ERNIE-4.5-21B-A3B-Thinking-Q4_K_M.gguf
228
- &mimo
329
license: mit
430
tags:

0 commit comments

Comments
 (0)