[2/n] [Serve] Refactor replica rank to prepare for node local ranks#58473

abrarsheikh wants to merge 1 commit intoLLM-2497-abrar-rank-p1ray-project/ray:LLM-2497-abrar-rank-p1from

LLM-2497-abrar-rank-p2ray-project/ray:LLM-2497-abrar-rank-p2Copy head branch name to clipboard