Machine Learning Engineering Open Book
Projects tagged #inference
// inference (7)
// uncategorizedstas00/⟨Python⟩★ 19,690◷ CC-BY-SA-4.0[ claude ]
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
// uncategorizedkvcache-ai/⟨C++⟩★ 7,045◷ Apache-2.0[ claude ]
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separa…
// ragraullenchai/⟨Python⟩★ 4,145◷ Apache-2.0[ claude ]
Communicate with an LLM provider using a single interface
// devtoolsmozilla-ai/⟨Python⟩★ 2,253◷ Apache-2.0[ claude ]
OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool call…
// ragwaybarrios/⟨Python⟩★ 1,657◷ Apache-2.0[ claude ]
MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)
// automationjjang-ai/★ 991[ claude ]
Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. N…
// mcp-serversmohitsoni48/⟨TypeScript⟩★ 296[ claude ]