EricLBuehlercandle-vllm★ 725Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.Rust89 個 Fork