Shangming Cai

Latest

• TENT: A Declarative Slice Spraying Engine for Performant and Resilient Data Movement in Disaggregated LLM Serving
• Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving