Skip to content

Commit d6d0f74

Browse files
committed
fix error
Title Summary Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
1 parent 4bf0a10 commit d6d0f74

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/e2e/vLLM/run_vllm.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ def parse_args():
1818
except json.JSONDecodeError as e:
1919
raise ValueError(f"Invalid JSON input: {e}")
2020

21-
if "W4A16_2of4" in scheme:
21+
if scheme is not None and "W4A16_2of4" in scheme:
2222
# required by the kernel
2323
llm_kwargs["dtype"] = torch.float16
2424

0 commit comments

Comments
 (0)