Skip to content

Commit 8af51e4

Browse files
committed
Add comment to get_kv_connector_kv_cache_events for clarity
Clarify that it is the workser side that calls the method. Review comment: - #28309 (comment) Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
1 parent f40f3ea commit 8af51e4

File tree

1 file changed

+2
-0
lines changed
  • vllm/distributed/kv_transfer/kv_connector/v1

1 file changed

+2
-0
lines changed

vllm/distributed/kv_transfer/kv_connector/v1/base.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -382,6 +382,8 @@ def get_kv_connector_stats(self) -> Optional["KVConnectorStats"]:
382382
def get_kv_connector_kv_cache_events(self) -> Optional["KVEventBatch"]:
383383
"""
384384
Get the KV connector kv cache events collected during the last interval.
385+
This function should be called by the model runner every time after the
386+
model execution and before cleanup.
385387
"""
386388
return None
387389

0 commit comments

Comments
 (0)