Skip to content

Commit a7e1a90

Browse files
committed
needs to be symmetric for MoE
Summary Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
1 parent 6d6f237 commit a7e1a90

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/e2e/vLLM/recipes/WNA16/recipe_w4a16_group_quant_first_10_layers.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ quant_stage:
1212
weights:
1313
num_bits: 4
1414
type: "int"
15-
symmetric: False
15+
symmetric: True
1616
strategy: "group"
1717
group_size: 128
1818
input_activations: null

0 commit comments

Comments
 (0)