Skip to content

Commit 8d20b36

Browse files
HDCharlesHDCharles
committed
more fixes
1 parent 7454665 commit 8d20b36

File tree

8 files changed

+292
-239
lines changed

8 files changed

+292
-239
lines changed

‎log-fp4.log‎

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -6,10 +6,10 @@ configfile: pyproject.toml
66
plugins: anyio-4.11.0
77
collecting ... collected 1 item
88

9-
tests/e2e/vLLM/test_vllm.py::TestvLLM::test_vllm[/home/HDCharles/repos/llm-compressor/tests/e2e/vLLM/configs/fp4_nvfp4_moe.yaml] 2025-10-24T02:35:40.486098+0000 | set_up | INFO - ========== RUNNING ==============
10-
2025-10-24T02:35:40.486217+0000 | set_up | INFO - Qwen3-VL-30B-A3B-Instruct-NVFP4
9+
tests/e2e/vLLM/test_vllm.py::TestvLLM::test_vllm[/home/HDCharles/repos/llm-compressor/tests/e2e/vLLM/configs/fp4_nvfp4_moe.yaml] 2025-10-24T16:30:26.528531+0000 | set_up | INFO - ========== RUNNING ==============
10+
2025-10-24T16:30:26.528659+0000 | set_up | INFO - Qwen3-VL-30B-A3B-Instruct-NVFP4
1111
`torch_dtype` is deprecated! Use `dtype` instead!
12-
Loading checkpoint shards: 0%| | 0/13 [00:00<?, ?it/s]Loading checkpoint shards: 100%|██████████| 13/13 [00:00<00:00, 112.35it/s]Loading checkpoint shards: 100%|██████████| 13/13 [00:00<00:00, 112.18it/s]
12+
Loading checkpoint shards: 0%| | 0/13 [00:00<?, ?it/s]Loading checkpoint shards: 100%|██████████| 13/13 [00:00<00:00, 112.15it/s]Loading checkpoint shards: 100%|██████████| 13/13 [00:00<00:00, 112.01it/s]
1313
Map: 0%| | 0/1 [00:00<?, ? examples/s]Map: 0%| | 0/1 [00:00<?, ? examples/s]
1414
FAILED
1515

@@ -53,7 +53,7 @@ timeout = None
5353
../../rhdev/lib/python3.11/site-packages/transformers/image_utils.py:481:
5454
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
5555

56-
fp = <_io.BytesIO object at 0x7fed76cbe4d0>, mode = 'r'
56+
fp = <_io.BytesIO object at 0x7efdfae7a480>, mode = 'r'
5757
formats = ['BMP', 'DIB', 'GIF', 'JPEG', 'PPM', 'PNG', ...]
5858

5959
def open(
@@ -178,13 +178,13 @@ formats = ['BMP', 'DIB', 'GIF', 'JPEG', 'PPM', 'PNG', ...]
178178
warnings.warn(message)
179179
msg = "cannot identify image file %r" % (filename if filename else fp)
180180
> raise UnidentifiedImageError(msg)
181-
E PIL.UnidentifiedImageError: cannot identify image file <_io.BytesIO object at 0x7fed76cbe4d0>
181+
E PIL.UnidentifiedImageError: cannot identify image file <_io.BytesIO object at 0x7efdfae7a480>
182182

183183
../../rhdev/lib/python3.11/site-packages/PIL/Image.py:3560: UnidentifiedImageError
184184

185185
During handling of the above exception, another exception occurred:
186186

187-
self = <tests.e2e.vLLM.test_vllm.TestvLLM object at 0x7fed78821290>
187+
self = <tests.e2e.vLLM.test_vllm.TestvLLM object at 0x7efdfb7a5d50>
188188
test_data_file = '/home/HDCharles/repos/llm-compressor/tests/e2e/vLLM/configs/fp4_nvfp4_moe.yaml'
189189

190190
def test_vllm(self, test_data_file: str):
@@ -368,9 +368,9 @@ E
368368
E Additionally, the conservatorium has a strong alumni network, with graduates working in a wide range of musical fields around the world. This network can be a valuable resource for students and alumni as they navigate their careers and seek out new opportunities.
369369
E
370370
E Overall, the Sydney Conservatorium of Music is committed to supporting students and alumni as they transition into the music industry, and offers a range of internship and job placement opportunities to help them achieve success.<|im_end|>
371-
E . Failed with cannot identify image file <_io.BytesIO object at 0x7fed76cbe4d0>
371+
E . Failed with cannot identify image file <_io.BytesIO object at 0x7efdfae7a480>
372372

373373
../../rhdev/lib/python3.11/site-packages/transformers/image_utils.py:483: ValueError
374374
=========================== short test summary info ============================
375375
FAILED tests/e2e/vLLM/test_vllm.py::TestvLLM::test_vllm[/home/HDCharles/repos/llm-compressor/tests/e2e/vLLM/configs/fp4_nvfp4_moe.yaml]
376-
============================== 1 failed in 11.76s ==============================
376+
============================== 1 failed in 10.40s ==============================

‎log-fp8.log‎

Lines changed: 71 additions & 163 deletions
Large diffs are not rendered by default.

‎log-int4.log‎

Lines changed: 194 additions & 56 deletions
Large diffs are not rendered by default.

‎run.sh‎

Lines changed: 9 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,14 @@
1-
export TEST_DATA_FILE="${REPOS}/llm-compressor/tests/e2e/vLLM/configs/fp8_dynamic_per_tensor_moe.yaml" # working
2-
pytest tests/e2e/vLLM/test_vllm.py -vs 2>&1 | tee log-fp8.log
1+
# export TEST_DATA_FILE="${REPOS}/llm-compressor/tests/e2e/vLLM/configs/w4a16_channel_quant.yaml" # working
2+
# pytest tests/e2e/vLLM/test_vllm.py -vs 2>&1 | tee log-int4-base.log
33

4-
export TEST_DATA_FILE="${REPOS}/llm-compressor/tests/e2e/vLLM/configs/w4a16_channel_quant_moe.yaml" # working
4+
# export TEST_DATA_FILE="${REPOS}/llm-compressor/tests/e2e/vLLM/configs/fp8_dynamic_per_tensor_moe.yaml" # working
5+
# pytest tests/e2e/vLLM/test_vllm.py -vs 2>&1 | tee log-fp8.log
6+
7+
export TEST_DATA_FILE="${REPOS}/llm-compressor/tests/e2e/vLLM/configs/w4a16_channel_quant_moe.yaml"
58
pytest tests/e2e/vLLM/test_vllm.py -vs 2>&1 | tee log-int4.log
69

7-
export TEST_DATA_FILE="${REPOS}/llm-compressor/tests/e2e/vLLM/configs/fp4_nvfp4_moe.yaml"
8-
pytest tests/e2e/vLLM/test_vllm.py -vs 2>&1 | tee log-fp4.log
10+
# export TEST_DATA_FILE="${REPOS}/llm-compressor/tests/e2e/vLLM/configs/fp4_nvfp4_moe.yaml"
11+
# pytest tests/e2e/vLLM/test_vllm.py -vs 2>&1 | tee log-fp4.log
12+
913

10-
export TEST_DATA_FILE="${REPOS}/llm-compressor/tests/e2e/vLLM/configs/fp4_nvfp4.yaml"
11-
pytest tests/e2e/vLLM/test_vllm.py -vs 2>&1 | tee log-fp-base.log
1214

‎tests/e2e/e2e_utils.py‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -46,6 +46,7 @@ def run_oneshot_for_e2e_testing(
4646
)
4747

4848
if dataset_id:
49+
print(dataset_id, dataset_config, dataset_split)
4950
ds = load_dataset(dataset_id, name=dataset_config, split=dataset_split)
5051
ds = ds.shuffle(seed=42).select(range(num_calibration_samples))
5152
ds = process_dataset(ds, processor, max_seq_length)

‎tests/e2e/vLLM/configs/fp4_nvfp4_moe.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,5 +4,5 @@ model: Qwen/Qwen3-VL-30B-A3B-Instruct
44
model_class: "Qwen3VLMoeForConditionalGeneration"
55
scheme: NVFP4
66
num_calibration_samples: 1
7-
dataset_id: HuggingFaceH4/ultrachat_200k
7+
dataset_id: HuggingFaceM4/flickr30k
88
dataset_split: train_sft

‎tests/e2e/vLLM/configs/w4a16_channel_quant_moe.yaml‎

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,7 @@ test_type: "regression"
33
model: Qwen/Qwen3-VL-30B-A3B-Instruct
44
model_class: "Qwen3VLMoeForConditionalGeneration"
55
scheme: W4A16
6-
dataset_id: HuggingFaceH4/ultrachat_200k
7-
dataset_split: train_sft
6+
num_calibration_samples: 1
7+
dataset_id: HuggingFaceM4/flickr30k
8+
dataset_split: "calibration"
89
quant_type: "GPTQ"

‎tests/testing_utils.py‎

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -312,8 +312,11 @@ def process(example):
312312

313313
else:
314314
raise NotImplementedError(f"Cannot preprocess dataset {ds.info.dataset_name}")
315-
316-
ds = ds.map(process, remove_columns=ds.column_names)
315+
try:
316+
ds = ds.map(process, remove_columns=ds.column_names)
317+
except Exception as e:
318+
print(e)
319+
317320

318321
return ds
319322

0 commit comments

Comments
 (0)