danielmiessler/Ladder

Ladder

A system for autonomous creation and optimization.

Pipeline · Cognitive Phases · The Loop · Quick Start · Fork It · Related Work

---

Ladder is an open system for autonomous creation and optimization — collecting ideas, forming hypotheses, running experiments, and applying results in a continuous loop. It structures the same process that has driven every major period of human innovation, from the Renaissance to Bell Labs, and makes it executable by humans, AI agents, or both.

Why Ladder?

Every great leap in human progress has followed the same pattern. Renaissance Florence had its salons and workshops — polymaths gathering diverse knowledge, debating ideas, testing them in art and engineering. The Enlightenment had its coffeehouses and scientific societies — structured observation, hypothesis, experimentation. Bell Labs had its open hallways — mathematicians colliding with engineers, theorists stealing from experimentalists, results feeding back into new research.

The process is always the same:

1. Consume widely — read, learn, experience across domains
2. Face problems — encounter challenges worth solving
3. Think deeply — apply what you know to the problem
4. Learn from results — observe what worked and what didn't
5. Talk with others — exchange ideas with different perspectives
6. Steal and combine — copy, modify, and merge ideas from other fields
7. Sleep on it — let the subconscious make connections you can't force
8. Absorb new inputs — keep feeding the system with fresh material
9. Get sudden inspiration — the insight arrives
10. Test and repeat — try it, learn, loop back

This is the engine behind every major advance. Ladder takes this engine and makes it autonomous — structured enough for AI agents to run, observable enough to optimize, and open enough for anyone to use.

"We basically take the human process of learning, thinking, combining and copying ideas, sleeping on them, trying them out — and we automate the hell of it at scale." — A Possible Path to ASI

The Pipeline

Ladder organizes work into six collections, each a stage in the autonomous optimization pipeline:

Each entry is a markdown file with structured frontmatter. Results feed back as sources for the next cycle — the loop that drives continuous, autonomous improvement.

Cognitive Phases

Ladder's ideation stage is modeled on the phases of human innovation that have driven progress for centuries. These aren't arbitrary categories — they're the observable patterns behind how breakthroughs actually happen, from Renaissance workshops to modern research labs.

The pattern repeats across every era of innovation: consume broadly, recombine freely, test ruthlessly, learn and repeat. Florentine salons did this over wine. Bell Labs did it in open-plan offices. Silicon Valley does it in garages and group chats. Ladder does it autonomously.

The Loop

The most important concept in Ladder is the loop: results don't just sit there — they feed back as sources for the next cycle of creation and optimization.

A result might reveal a new problem (→ source), suggest a better approach (→ idea), or validate an algorithm (→ algorithm). This closed loop is what transforms a static collection into an autonomous optimization engine that continuously improves itself and whatever system it's pointed at.

This is the same process described in Pursuing the Algorithm — a generalized hill-climbing approach that applies to any domain. Observe, hypothesize, test, learn, repeat. The loop is what makes it work.

Quick Start

# Clone
git clone https://github.com/danielmiessler/Ladder.git
cd Ladder

# Install dependencies
bun install

# Add an idea
bun run ladder add idea --title "Use semantic caching for API responses"

# Add a hypothesis from that idea
bun run ladder add hypothesis --idea ID-00001 --title "Semantic cache reduces API calls by 40%"

# Add an experiment
bun run ladder add experiment --hypothesis HY-00001 --title "A/B test semantic cache vs direct calls"

# Check pipeline status
bun run ladder status

# List all ideas
bun run ladder list ideas

Directory Structure

Ladder/
├── Sources/           # SR- Raw inputs and references
│   ├── README.md
│   └── TEMPLATE.md
├── Ideas/             # ID- Candidate solutions
│   ├── README.md
│   └── TEMPLATE.md
├── Hypotheses/        # HY- Testable predictions
│   ├── README.md
│   └── TEMPLATE.md
├── Experiments/       # EX- Structured tests
│   ├── README.md
│   └── TEMPLATE.md
├── Algorithms/        # AL- Proven methods
│   ├── README.md
│   └── TEMPLATE.md
├── Results/           # RE- Verified outcomes
│   ├── README.md
│   └── TEMPLATE.md
├── Tools/             # TypeScript CLI tooling
├── README.md
├── CLAUDE.md
├── CONTRIBUTING.md
└── LICENSE

Fork It

Ladder is designed to be forked. Your fork is your instance — your problems, your ideas, your experiments.

Personal use: Fork it, point it at your own work, and let it find optimizations you'd never spot manually.

Enterprise use: Fork it, scope it to your system. Your agents discover problems in your infrastructure, submit them as sources, and the pipeline autonomously turns them into verified improvements.

AI integration: Point your AI agents at your Ladder fork. Anytime an agent encounters a problem or sees an opportunity, it submits to the pipeline. The pipeline is the autonomous optimization engine; the agents are sources of observations.

Philosophy

Ladder is built on three beliefs:

1. Progress is a loop, not a line. Every great era of innovation — the Renaissance, the Enlightenment, the Bell Labs era — was driven by tight feedback loops between observation, creation, and testing.
2. Structure enables creativity. Naming the cognitive phases doesn't constrain thinking — it makes it observable and improvable. The Royal Society didn't kill creativity by insisting on reproducibility; it accelerated it.
3. Autonomy is the goal. The system should be able to run without human intervention — discovering problems, generating ideas, testing hypotheses, and applying results continuously.

Related Work

Ladder draws from a body of interconnected ideas about autonomous optimization, AI capability, and human creativity:

Core Concepts

• A Possible Path to ASI — The foundational thesis: ASI through scaled ideation and experimentation, emulating the human creative process
• Pursuing the Algorithm — The concept of a generalized algorithm for continuous improvement across any domain
• Nobody is Talking About Generalized Hill-Climbing — Why runtime optimization through iterative hill-climbing is the key capability most people are missing
• Introducing Substrate — Open-source infrastructure for collecting problems, solutions, and evidence at scale

AI & Knowledge Work

• AI's Ultimate Use Case: State Transition — Moving from current state to desired state as the core function of intelligence
• RAID (Real World AI Definitions) — Precise definitions for AGI, ASI, and other AI concepts referenced throughout Ladder
• Exactly Why and How AI Will Replace Knowledge Work — The economic forces driving AI adoption and why autonomous pipelines matter
• Bitter Lesson Engineering — Why you should build infrastructure that improves with scale, not clever workarounds

Creativity & Innovation

• Creative Output Requires Quality Inputs — Why the CONSUME phase matters: garbage in, garbage out
• Increasing Creativity By Separating Input and Output Phases — The science behind Ladder's phase separation
• The Two Primary Limitations to Our Creativity — The constraints that Ladder's cognitive phases are designed to overcome
• AI and the World's Most Important Economic Metric — How reducing the friction of creation changes everything

Systems & Infrastructure

• Building a Personal AI Infrastructure (PAI) — The broader system that Ladder integrates with
• How My Projects Fit Together — Where Ladder sits in the ecosystem alongside Fabric, Substrate, and PAI
• Companies Are Just a Graph of Algorithms — Why Ladder's algorithm collection matters: every process is an algorithm that can be optimized
• Why I Created Fabric — The origin of the pattern-based approach that Ladder extends

Human Progress

• The Problem with Human 2.0 and the Promise of Human 3.0 — The vision of humans as creators, augmented by autonomous tools like Ladder
• Algorithmic Learning — Learning as a structured, improvable process — not just accumulation
• Algorithmic vs. Faith-based Learning — Why verifiable, iterative learning beats untested assumptions
• The Great Transition — The societal shift that makes autonomous creation tools necessary

Acknowledgments

I've been thinking about autonomous optimization loops for a long time, but Andrej Karpathy has been a continuous source of inspiration along the way. His Software 2.0 framing — the shift from hand-written logic to learned systems — helped sharpen how I think about verifiability and what it means for outputs to be checkable. His more recent work on autonomous research automation resonates deeply with what Ladder is trying to do: structure the creative loop so it can run on its own.

→ Software 2.0 → @karpathy on X

Contributing

See CONTRIBUTING.md for how to submit sources, ideas, hypotheses, experiments, and results.

License

MIT — see LICENSE for details.