Kaichao You
Core Maintainer of vLLM
Dr. Kaichao You, a graduate of Tsinghua University, has been continuously involved in the development of the vLLM project since visiting the University of California, Berkeley in 2024. He is a core maintainer of vLLM, responsible for its distributed inference architecture, integration with torch.compile, open-source collaboration, and other key aspects.
Topic
vLLM: Accessible, Fast, and Cost-Effective Large Model Inference Service for Everyone
vLLM is an efficient and user-friendly library for large language model (LLM) inference and deployment. This talk will briefly introduce the development history of the vLLM project and its supporting open-source community, and will focus on sharing several key features that have attracted user attention.
