Awesome Model Serving Papers and Source Codes

vLLM: High-Throughput, Memory-Efficient LLM Serving for Real-World Applications 65106

If you’re building or scaling a system that relies on large language models (LLMs)—whether for chatbots, embeddings, multimodal reasoning, or…

01/04/2026Efficient Attention, LLM Inference, Model Serving

AIBrix: Scalable, Cost-Effective LLM Inference Infrastructure for Enterprise-Grade GenAI Deployment 4460

Deploying large language models (LLMs) at scale in production environments remains a significant challenge for engineering teams. High inference costs,…

12/19/2025GenAI Deployment, LLM Inference, Model Serving