LLM Frontend for Power Users. If you intend to do LLM inference on your local machine, we recommend a 3000-series NVIDIA graphics card with at least 6GB of VRAM, but actual requirements may vary depending on the model and backend you choose to use.
JavaScriptAI & Machine Learning6,554 forks7 min read