Skip to content

Commit aa7cb7e

Browse files
authored
chore(model gallery): add aquif-ai_aquif-3.5-8b-think (#6269)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent eadd3d4 commit aa7cb7e

File tree

1 file changed

+15
-0
lines changed

1 file changed

+15
-0
lines changed

gallery/index.yaml

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2570,6 +2570,21 @@
25702570
- filename: minicpm-v-4_5-mmproj-f16.gguf
25712571
uri: huggingface://openbmb/MiniCPM-V-4_5-gguf/mmproj-model-f16.gguf
25722572
sha256: 7a7225a32e8d453aaa3d22d8c579b5bf833c253f784cdb05c99c9a76fd616df8
2573+
- !!merge <<: *qwen3
2574+
name: "aquif-ai_aquif-3.5-8b-think"
2575+
urls:
2576+
- https://huggingface.co/aquif-ai/aquif-3.5-8B-Think
2577+
- https://huggingface.co/bartowski/aquif-ai_aquif-3.5-8B-Think-GGUF
2578+
description: |
2579+
The aquif-3.5 series is the successor to aquif-3, featuring a simplified naming scheme, expanded Mixture of Experts (MoE) options, and across-the-board performance improvements. This release streamlines model selection while delivering enhanced capabilities across reasoning, multilingual support, and general intelligence tasks.
2580+
An experimental small-scale Mixture of Experts model designed for multilingual applications with minimal computational overhead. Despite its compact active parameter count, it demonstrates competitive performance against larger dense models.
2581+
overrides:
2582+
parameters:
2583+
model: aquif-ai_aquif-3.5-8B-Think-Q4_K_M.gguf
2584+
files:
2585+
- filename: aquif-ai_aquif-3.5-8B-Think-Q4_K_M.gguf
2586+
sha256: 9e49b9c840de23bb3eb181ba7a102706c120b3e3d006983c3f14ebae307ff02e
2587+
uri: huggingface://bartowski/aquif-ai_aquif-3.5-8B-Think-GGUF/aquif-ai_aquif-3.5-8B-Think-Q4_K_M.gguf
25732588
- &gemma3
25742589
url: "github:mudler/LocalAI/gallery/gemma.yaml@master"
25752590
name: "gemma-3-27b-it"

0 commit comments

Comments
 (0)