claudeers.

🔓 unclaimed — this page was auto-generated from GitHub. Are you the creator?

Claim this page →
// Automation & Workflows

awesome-autoresearch

A curated list of autonomous improvement loops, research agents, and autoresearch-style systems inspired by Karpathy's autoresearch.

Actively maintained
96/100
last commit 17 days ago
last release none
releases 0
open issues 6
// install
git clone https://github.com/webfuse-com/awesome-autoresearch

🔬 Awesome Autoresearch

A curated, high-signal index of autonomous improvement loops, research agents, and descendants inspired by karpathy/autoresearch.

Contents

🛠️ General-purpose descendants

  • kayba-ai/recursive-improve - Recursive self-improvement framework where agents capture execution traces, analyze failure patterns, and apply targeted fixes with keep-or-revert evaluation.
  • vukrosic/auto-research - Docs-only control plane for an open autonomous AI research lab — file-based operating model for human direction and agent execution.
  • uditgoenka/autoresearch - Claude Code skill that generalizes autoresearch into a reusable loop for software, docs, security, shipping, debugging, and other measurable goals.
  • leo-lilinxiao/codex-autoresearch - Codex-native autoresearch skill with resume support, lessons across runs, optional parallel experiments, and mode-specific workflows.
  • SeeleAI/Thoth - Dashboard-first Claude Code and Codex runtime for autoresearch, with durable runs, locked work items, visible ledgers, and reviewable verdicts.
  • supratikpm/gemini-autoresearch - Gemini CLI skill that generalises autoresearch to any measurable goal. Gemini-native: uses Google Search grounding as a live verification source inside the loop, true headless overnight mode via --yolo --prompt, and 1M token context. Also works in Antigravity IDE via .agents/skills/.
  • davebcn87/pi-autoresearch - pi extension plus dashboard for persistent experiment loops, live metrics, confidence tracking, and resumable autoresearch sessions.
  • drivelineresearch/autoresearch-claude-code - Claude Code plugin/skill port of pi-autoresearch, with a clean experiment-loop workflow and a concrete biomechanics case study.
  • greyhaven-ai/autocontext - Closed-loop control plane for repeated agent improvement, with evaluation, persistent knowledge, staged validation, and optional distillation into cheaper local runtimes.
  • Necmttn/ax - Local retro loop for AI coding agents: captures session traces, turns repeated friction into proposals, and tracks accepted fixes as experiments.
  • jmilinovich/goal-md - Generalizes autoresearch into a GOAL.md pattern for repos where the agent must first construct a measurable fitness function before it can optimize.
  • james-s-tayler/lazy-developer - Claude Code skill that orchestrates autoresearch across a prioritized sequence of optimization goals (coverage, test speed, build speed, complexity, LOC, performance) using GOAL.md as the engine. Supports standalone and Ralph Mode multi-instance execution.
  • mutable-state-inc/autoresearch-at-home - Collaborative fork of upstream autoresearch that adds experiment claiming, shared best-config syncing, hypothesis exchange, and swarm-style coordination across many single-GPU agents.
  • zkarimi22/autoresearch-anything - Generalizes autoresearch to any measurable metric — system prompts, API performance, landing pages, test suites, config tuning, SQL queries. "If you can measure it, you can optimize it."
  • Entrpi/autoresearch-everywhere - Cross-platform expansion that auto-detects hardware config and starts the loop. The "glue and generalization" half of autoresearch.
  • ShengranHu/ADAS - Automated Design of Agentic Systems — ICLR 2025. Meta-agents that invent novel agent architectures by programming them in code.
  • MaximeRobeyns/self_improving_coding_agent - SICA: Self-Improving Coding Agent that edits its own codebase. ICLR 2025 Workshop paper demonstrating scaffold-level self-improvement on coding benchmarks.
  • peterskoett/self-improving-agent - Alternative self-improving agent architecture with reflection and meta-learning cycles.
  • metauto-ai/HGM - Huxley-Gödel Machine for coding agents — applies self-improvement to SWE-bench performance via meta-level optimization.
  • gepa-ai/gepa - GEPA (Genetic-Pareto) — ICLR 2026 Oral. Reflective prompt evolution that outperforms RL (GRPO) on benchmarks. Optimizes any textual parameters against any metric using natural language reflection.
  • sentient-agi/EvoSkill - Automated skill discovery for coding agents: evolves reusable skills and prompts from failed trajectories against benchmarks, with support for Claude Code, Codex CLI, OpenCode, OpenHands, and Goose.
  • MrTsepa/autoevolve - GEPA-inspired autoresearch for self-play: mutate code strategies, evaluate head-to-head, rate with Elo/Bradley-Terry, branch from the Pareto front. Agent reads match traces to target mutations. Works as a Claude Code skill.
  • HKUDS/ClawTeam - Agent swarm intelligence for autoresearch — spawns parallel GPU research directions, distributes work across agents, aggregates results.
  • Orchestra-Research/AI-Research-SKILLs - Comprehensive skill library including autoresearch orchestration with two-loop architecture (inner optimization + outer synthesis).
  • WecoAI/aideml - AIDE: Tree-search ML engineering agent that autonomously improves model performance via iterative code generation and evaluation.
  • weco.ai - Weco: Cloud platform for AIDE with observability, experiment tracking, and managed runs — brings the autoresearch loop into production.

🔬 Research-agent systems

  • aiming-lab/AutoResearchClaw - End-to-end research pipeline that turns a topic into literature review, experiments, analysis, peer review, and paper drafts; broader than autoresearch, but clearly in the same lineage.
  • OpenRaiser/NanoResearch - End-to-end autonomous research engine that plans experiments, generates code, runs jobs locally or on SLURM, analyzes real results, and writes papers grounded in those outputs.
  • kaust-ark/ARK - ARK (Automatic Research Kit): idea + venue → paper pipeline orchestrating 6 agents — proposal analysis, literature search, Slurm experiments, LaTeX drafting, iterative peer review. Controlled via CLI, web dashboard, or Telegram.
  • wanshuiyin/Auto-claude-code-research-in-sleep - Markdown-first research workflows for Claude Code and other agents, centered on autonomous literature review, experiments, paper iteration, and cross-model critique.
  • skyllwt/AutoSci - Wiki-centric full-lifecycle research platform built on Claude Code, realizing Karpathy's LLM-Wiki vision. 20+ skills cover the full loop: ingest → ideate → novelty check → experiment design / run / eval → paper writing. Research state lives in a structured knowledge wiki with an interactive graph.
  • Sibyl-Research-Team/AutoResearch-SibylSystem - Fully autonomous AI scientist built on Claude Code, with explicit AutoResearch lineage, multi-agent research iteration, GPU experiment execution, and a self-evolving outer loop.
  • eimenhmdt/autoresearcher - Early open-source package for automating scientific workflows, currently centered on literature-review generation with an ambition toward broader autonomous research.
  • hyperspaceai/agi - Distributed, peer-to-peer research network where autonomous agents run experiments, gossip findings, maintain CRDT leaderboards, and archive results to GitHub across multiple research domains.
  • Human-Agent-Society/CORAL - CORAL: Autonomous multi-agent evolution for open-ended discovery (arXiv:2604.01658). Long-running agents with shared persistent memory, asynchronous execution, and heartbeat-based interventions; SOTA on 10 math/algorithmic/systems tasks.
  • SakanaAI/AI-Scientist - The AI Scientist: First comprehensive system for fully automatic scientific discovery. From idea generation to paper writing with minimal human supervision.
  • SakanaAI/AI-Scientist-v2 - Workshop-level automated scientific discovery via agentic tree search. Removes template dependency from v1, generalizes across research domains.
  • AweAI-Team/AiScientist - AiScientist: long-horizon ML research lab with hierarchical orchestration and File-as-Bus coordination — workspace files act as the durable system of record. Drives autonomous paper-reproduction (PaperBench) and competition-style MLE-Bench iteration loops under fixed compute/time budgets. (arXiv 2604.13018)
  • HKUDS/AI-Researcher - NeurIPS 2025 paper. Full end-to-end research automation: hypothesis → experiments → manuscript → peer review. Production version at novix.science.
  • openags/Auto-Research - OpenAGS: Orchestrates a team of AI agents across the full research lifecycle — lit review, hypothesis generation, experiments, manuscript writing, and peer review.
  • SamuelSchmidgall/AgentLaboratory - End-to-end autonomous research workflow: idea → literature review → experiments → report. Supports both autonomous and co-pilot modes.
  • AgentRxiv - Collaborative autonomous research framework where agent laboratories share a preprint server to build on each other's work iteratively.
  • JinheonBaek/ResearchAgent - Iterative research idea generation over scientific literature with LLMs. Multi-agent review and feedback loops.
  • du-nlp-lab/MLR-Copilot - Autonomous ML research framework — generates ideas, implements experiments, analyzes results.
  • MASWorks/ML-Agent - Reinforcing LLM agents for autonomous ML engineering. Learns from trial and error to improve model performance.
  • PouriaRouzrokh/LatteReview - Low-code Python package for automated systematic literature reviews via AI-powered agents.
  • LitLLM/LitLLM - AI-powered literature review assistant using RAG for accurate, well-structured related-work sections in academic writing.
  • Agent Laboratory - Three-phase research pipeline: Literature Review → Experimentation → Report Writing, with specialized agents for each phase.

💻 Platform ports and hardware forks

  • gianfrancopiana/openclaw-autoresearch - OpenClaw port of pi-autoresearch; autonomous experiment loop for any optimization target with statistical confidence scoring.
  • miolini/autoresearch-macos - Widely adopted macOS fork that adapts upstream autoresearch for Apple Silicon / MPS while preserving the original loop shape.
  • trevin-creator/autoresearch-mlx - MLX-native Apple Silicon port that keeps the upstream fixed-budget val_bpb loop while removing the PyTorch/CUDA dependency entirely.
  • jsegov/autoresearch-win-rtx - Windows-native RTX fork focused on consumer NVIDIA GPUs, with explicit VRAM floors and a practical desktop setup path.
  • iii-hq/n-autoresearch - Multi-GPU autoresearch infrastructure with structured experiment tracking, adaptive search strategy, crash recovery, and queryable orchestration around the classic train.py loop.
  • lucasgelfond/autoresearch-webgpu - Browser/WebGPU port that lets agents generate training code, run experiments in-browser, and feed results back into the loop without a Python setup.
  • tonitangpotato/autoresearch-engram - Fork with persistent cognitive memory — frequency-weighted retrieval of cross-session knowledge for improved experiment continuity.
  • Colab/Kaggle T4 port - Adapts autoresearch for free T4 GPUs (Google Colab / Kaggle) with zero cost and zero local setup. Key changes: Flash Attention 3 → PyTorch SDPA, removes H100-only kernel dependency.
  • ArmanJR-Lab/autoautoresearch - Jetson AGX Orin port with a director — a Go binary that acts as a "creative director" injecting novelty (arxiv papers + DeepSeek Reasoner) into the loop to escape local minima. Includes multi-experiment comparison (baseline vs director-guided) with detailed stall analysis.

🎯 Domain-specific adaptations

  • mattprusak/autoresearch-genealogy - Applies the autoresearch pattern to genealogy, using structured prompts, archive guides, source checks, and vault workflows to iteratively expand and verify family-history research.
  • ArchishmanSengupta/autovoiceevals - Uses adversarial callers plus keep-or-revert prompt edits to harden voice AI agents across Vapi, Smallest AI, and ElevenLabs.
  • chrisworsey55/atlas-gic - Applies the autoresearch keep-or-revert loop to trading agents, optimizing prompts and portfolio orchestration against rolling Sharpe ratio instead of model loss.
  • RightNow-AI/autokernel - Applies the autoresearch loop to GPU kernel optimization: profile bottlenecks, edit one kernel, benchmark, keep or revert, repeat.
  • ElliotXie/autozyme - Multi-agent framework that applies the autoresearch keep-or-revert loop to CPU-side scientific software: profile a target function, generate one optimization candidate, benchmark for speed while preserving the original outputs, keep or revert, repeat.
  • Agent-Analytics/autoresearch-growth - Applies autoresearch to landing-page positioning and A/B test candidates, using analytics snapshots and measured experiment results to seed subsequent rounds.
  • Rkcr7/autoresearch-sudoku - Enhanced autoresearch workflow where an AI agent iteratively rewrites and benchmarks a Rust sudoku solver, ultimately beating leading human-built solvers on hard benchmark sets.
  • jeongph/autospec - Reads natural-language business rules and autonomously builds a Spring Boot service with tests via the keep-or-revert loop. Evaluates with Gradle build + JUnit XML. 119-line skeleton to 950 lines in 5 cycles.
  • vlasenkoalexey/tpu_performance_autoresearch_wiki - Applies the autoresearch keep-or-revert loop to TPU model performance (MFU / tokens-per-sec) on v6e hardware: profiles each run through an XProf MCP server, makes one model-code change per experiment, and keeps or reverts against measured MFU. Pairs the loop with a Karpathy-style LLM wiki for domain knowledge and per-experiment optimization traces; includes Llama3-8B and Qwen3-8B case studies across JAX and torchax lanes.

📊 Evaluation & benchmarks

  • snap-stanford/MLAgentBench - Benchmark suite for evaluating AI agents on ML experimentation tasks. 13 tasks from CIFAR-10 to BabyLM.
  • OpenAI/mle-bench - OpenAI's benchmark for measuring how well AI agents perform at ML engineering.
  • chchenhui/mlrbench - MLR-Bench: Evaluating AI agents on open-ended ML research. 201 tasks from NeurIPS/ICLR/ICML workshops.
  • gersteinlab/ML-Bench - Evaluates LLMs and agents for ML tasks on repository-level code.
  • THUDM/AgentBench - Comprehensive benchmark for LLM-as-Agent evaluation across 8 distinct environments. ICLR 2024.

📈 Notable use cases and writeups

Curated lists and paper collections for AI agents, autonomous systems, and automated research:

📄 License

This list is released under CC0-1.0.

// compatibility

Platformscli, api, desktop, web
Operating systems
AI compatibilityclaude
LicenseNOASSERTION
Pricingopen-source
Language

// faq

What is awesome-autoresearch?

A curated list of autonomous improvement loops, research agents, and autoresearch-style systems inspired by Karpathy's autoresearch.. It is open-source on GitHub.

Is awesome-autoresearch free to use?

awesome-autoresearch is open-source under the NOASSERTION license, so it is free to use.

What category does awesome-autoresearch belong to?

awesome-autoresearch is listed under automation in the Claudeers registry of Claude-compatible tools.

0 views
2,303 stars
unclaimed
updated 10 days ago

// embed badge

awesome-autoresearch on Claudeers
[![Claudeers](https://claudeers.com/api/badge/awesome-autoresearch.svg)](https://claudeers.com/awesome-autoresearch)

// retro hit counter

awesome-autoresearch hit counter
[![Hits](https://claudeers.com/api/counter/awesome-autoresearch.svg)](https://claudeers.com/awesome-autoresearch)

// reviews

// guestbook

0/500

// related in Automation & Workflows

🔓

The agent that grows with you

// automationNousResearch/Python211,605MIT[ claude ]
🔓

The API to search, scrape, and interact with the web at scale. 🔥

// automationfirecrawl/TypeScript143,720AGPL-3.0[ claude ]
🔓

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

// automationbrowser-use/Python103,709MIT[ claude ]
🔓

An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message…

// automationbytedance/Python76,016MIT[ claude ]

// built by

Connectorlinks several projects together across the ecosystem · 5 connections
→ see how awesome-autoresearch connects across the ecosystem