Weiran He

Latest

• Seer: Online Context Learning for Fast Synchronous LLM Reinforcement Learning
• Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving
• MOONCAKE: Trading More Storage for Less Computation —— A KVCache-centric Architecture for Serving LLM Chatbot
• MoBA: Mixture of Block Attention for Long-Context LLMs