Skip to content

Commit ae8adbc

Browse files
authored
Adjust default scorer weights (#1827)
1 parent 476127a commit ae8adbc

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

config/charts/inferencepool/templates/epp-config.yaml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,8 +15,11 @@ data:
1515
- name: default
1616
plugins:
1717
- pluginRef: queue-scorer
18+
weight: 2
1819
- pluginRef: kv-cache-utilization-scorer
20+
weight: 2
1921
- pluginRef: prefix-cache-scorer
22+
weight: 3
2023
{{- if (hasKey .Values.inferenceExtension "pluginsCustomConfig") }}
2124
{{- .Values.inferenceExtension.pluginsCustomConfig | toYaml | nindent 2 }}
2225
{{- end }}

0 commit comments

Comments
 (0)