🔓Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
// uncategorizedkvcache-ai/⟨C++⟩★ 6,707◷ Apache-2.0[ claude ]
Projects tagged #inference
// inference (6)
🔓
🔓The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separa…
// ragraullenchai/⟨Python⟩★ 3,871◷ Apache-2.0[ claude ]
🔓Communicate with an LLM provider using a single interface
// devtoolsmozilla-ai/⟨Python⟩★ 2,208◷ Apache-2.0[ claude ]
🔓OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool call…
// ragwaybarrios/⟨Python⟩★ 1,608◷ Apache-2.0[ claude ]
🔓MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)
// automationjjang-ai/★ 979[ claude ]
🔓Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. N…
// mcp-serversmohitsoni48/⟨TypeScript⟩★ 279[ claude ]