Skip to content

Commit dcbbfe6

Browse files
committed
Add comment to get_kv_connector_kv_cache_events for clarity
Clarify that it is the workser side that calls the method. Review comment: - vllm-project#28309 (comment) Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
1 parent cea973e commit dcbbfe6

File tree

1 file changed

+2
-0
lines changed
  • vllm/distributed/kv_transfer/kv_connector/v1

1 file changed

+2
-0
lines changed

vllm/distributed/kv_transfer/kv_connector/v1/base.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -353,6 +353,8 @@ def get_kv_connector_stats(self) -> Optional["KVConnectorStats"]:
353353
def get_kv_connector_kv_cache_events(self) -> Optional["KVEventBatch"]:
354354
"""
355355
Get the KV connector kv cache events collected during the last interval.
356+
This function should be called by the model runner every time after the
357+
model execution and before cleanup.
356358
"""
357359
return None
358360

0 commit comments

Comments
 (0)