🔓The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separa…
// ragraullenchai/⟨Python⟩★ 3,205◷ Apache-2.0[ claude ]
Projects tagged #inference
// inference (5)
🔓
🔓Communicate with an LLM provider using a single interface
// devtoolsmozilla-ai/⟨Python⟩★ 2,098◷ Apache-2.0[ claude ]
🔓OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool call…
// ragwaybarrios/⟨Python⟩★ 1,411◷ Apache-2.0[ claude ]
🔓MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)
// automationjjang-ai/★ 847[ claude ]
🔓Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. N…
// mcp-serversmohitsoni48/⟨TypeScript⟩★ 159[ claude ]