EricLBuehlercandle-vllm★ 725Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.Rust89 个 Fork