Files
WebinarNotes/wiki/concepts/harness.md
EugeneTes 62d0f06a2d all
2026-07-30 11:13:27 +02:00

6.1 KiB
Raw Blame History

Harness

#concept

Summary

A harness is a universal agent = LLM + a small standard toolset + a runtime loop. The metaphor (Konstantin): the LLM is the force, the tools are the harness/upness, the data is the field — the LLM "pulls the tools across the data space," turning raw tasks into solved ones. Different tasks, same processing method.

Current Understanding

The harness is the de-facto unit of agentic work in 2026. A good one has: a short system prompt ("use the tools to solve the task"), ~1040 standard tools (Read/Edit/Write, Bash, Grep/Glob/WebSearch, TodoWrite, subagent spawn), a ReAct runtime loop, context management (timely summarization, subagents without full context), standardized key files (CLAUDE.md/AGENTS.md, skills/), resilience to failures, and an interface (CLI/chat/messenger). It runs in two modes: interactive (human-in-the-middle → man-on-the-middle) and autonomous fire-and-forget (CLI + task arg, embeddable in CI/CD).

Tool ceiling: >3040 built-in tools appears in no popular harness; >100 confuses even Fable 5 because every tool is injected into each call — a key reason skills-as-memory (two-stage loading) beat raw tools. See context-as-scarce-resource.

Consolidation over tool-hopping. The 2026-07-21-larysa-interview sharpens Eugene's pitch into its user-facing form: assemble one place where all your project agents live and can talk to each other, instead of spinning up the tool in separate folders and juggling apps. The claimed payoff is as much cognitive as productive — "you build yourself an operating system where you have everything in one place… When I built this thing, my life just split into before and after" — freeing mental overhead he hadn't noticed he was spending. Completion notifications ("done thinking") are part of the claim: they are what make background agents usable without babysitting. This is the engineer's phrasing of the webinar's title arc, chat box → your own OS (levels-of-ai-usage, personal-ai-operating-system).

The business-facing formula. An anonymous Russian business short (2026-07-22-ai-is-stupid) independently restates the concept for non-engineers: the harness is an "engineering wrapper" — what the model must verify, which tools to trust, how to shape the answer, what is forbidden — and strong model + your business context + harness = employee-level answer. Remove any component and you get "smart but generic," "specific but undisciplined," or "stupid AI." Useful as webinar language: it names what the audience already feels (generic answers) without requiring the engineering vocabulary.

A second reference harness: amp. Where claude-code is local-first and user-extended, AMP is sandbox-first and vendor-curated (2026-07-28-agentic-engineering-10x-developer): a PWA install, a low/medium/high/ultra dial that maps each level to a model and a sub-agent set, named sub-agents (Oracle the reviewer, Painter the image generator), a meta-agent (Puck) that spawns and messages other agents, and orbs — remote sandboxes where one URL carries thread + agent + computation + diff (see async-by-default). Two things it demonstrates about the concept: the harness is now the product (AMP's most-asked customer question is "what's the meta — what model, what prompt?", i.e. customers pay for research decisions), and a harness can be strong with no user-authored skills layer at all — the structure exists, but the vendor supplies it. That is the design axis hermes and Claude Code put in the user's hands.

The governance fault line: eugene argues every developer should build their own harness (deep knowledge → more effective). sebastian counters that "bring your own harness" cannot survive enterprise compliance — it must be a company-managed resource, and that gap is the business. See enterprise-ai-reality.

Evidence

Contradictions / Uncertainty

  • Personal vs company-managed harness is an unresolved tension (Eugene vs Sebastian), not a settled answer. amp adds a third option neither of them argues for: a vendor-managed harness, where the research decisions are the purchase and the user tunes almost nothing.
  • Local vs remote. Eugene's consolidation pitch assumes one place on your machine; Thorsten predicts local dev disappears into remote sandboxes. Compatible only if the thing being consolidated is the interface rather than the compute. Status: tentative.
  • The "life split into before and after" consolidation payoff is self-reported by its builder and never measured; Larysa, the practitioner it was pitched to, does not yet run one. Status: tentative.

Next Questions

  • What is the minimal compliant, centrally-managed harness a regulated team could adopt?