When a multi-agent design is justified
A single assistant with a clear contract and the right tools is easier to maintain. OpenAI recommends maximizing one agent before splitting, because additional agents introduce overhead. Split when one prompt contains too many conditional branches, similar tools are repeatedly confused, separate domains need distinct instructions, or parallel work creates a meaningful speed or coverage benefit.[1]
Anthropic describes several patterns that are often called multi-agent: routing sends a task to one specialist; parallelization runs independent subtasks; orchestrator-workers lets a lead dynamically create subtasks; evaluator-optimizer adds a critique loop. Choose the smallest pattern that addresses the measured failure.[2]
- The single-assistant baseline and failure mode are documented.
- Each specialist owns a distinct domain, toolset, or independent subtask.
- The quality or latency gain can be measured against added cost.
- A lead owns decomposition, conflict resolution, and final completion.
- The run can stop safely when one specialist fails or times out.
The lead-and-specialist contract
The lead receives the user goal and remains accountable for the final result. Before delegation, it defines the work product, evidence boundary, acceptance criteria, and subtask interfaces. Each specialist receives only the context required for its assignment and returns a structured result: findings, sources, assumptions, confidence, unresolved questions, and a completion signal.
Specialists should not silently create new goals or delegate again unless the architecture explicitly allows it. A shallow graph is easier to observe and limits cascading failure. When specialists disagree, the lead should preserve the conflict, compare source quality, and either resolve it through a deterministic rule or ask the user for judgment.[6] [4]
Task envelope
Goal, subtask, allowed context, tools, budget, output schema, and prohibited actions.
Evidence envelope
Source IDs, extracted claims, calculations, freshness, limitations, and confidence.
Completion envelope
Outcome status, checks performed, blockers, and recommended next step.
Control context, duplication, and conflict
Sending the complete conversation and every file to every specialist increases token cost and gives each worker irrelevant instructions to interpret. Build a task-specific context packet instead. Preserve immutable user constraints and approved facts, then add only the sources and decisions needed for that subtask.
Deduplicate research before synthesis. If two specialists cite the same source, one citation should not become two independent pieces of evidence. Normalize units, dates, entity names, and confidence labels. Track which statement originated from which specialist so a reviewer can trace a disputed recommendation.
- Immutable user goal and constraints are copied exactly.
- Each specialist receives a minimal context projection.
- Retrieved content is treated as untrusted data, not instruction.
- Source and claim identifiers survive handoffs.
- Numbers use common units, periods, and assumptions.
- Conflicts remain visible until a rule or person resolves them.
Verification and stopping conditions
A multi-agent run needs independent reasons to stop. Completion can mean required artifact fields exist, deterministic calculations reconcile, source coverage exceeds a threshold, or an approved tool confirms the expected state. Failure can mean a budget is exhausted, a critical source is unavailable, a specialist repeats the same error, or the task crosses an approval boundary.
Evaluate the final outcome and the trajectory. The final memo can look good even if a specialist accessed an unnecessary connector or ignored an instruction. Conversely, a longer trace may be appropriate for a difficult task. Agent evals should combine deterministic, model-based, and human graders according to what each can judge reliably.[3] [6]
How Kona bounds orchestration
Kona routes a Workspace task to a lead and no more than two specialists. The user can also select or @mention a specialist directly, which bypasses unnecessary routing when intent is already clear. Capability declarations keep web, code, canvas, and connectors attached to explicit assistant configurations.
The run record captures routing reason, participating assistants, status, verification, and operational telemetry. The lead synthesizes one answer and does not treat specialist output as automatically verified. External mutations remain behind approval. This design favors controlled specialization over unbounded agent proliferation.[8] [9] [10]
Common orchestration patterns
The right pattern depends on whether the path is known, tasks are independent, or delegation must be discovered.
| Pattern | Use it when | Control to add |
|---|---|---|
| Router to specialist | One domain should handle the complete request | Confidence threshold and fallback when routing is ambiguous |
| Fixed workflow | The same ordered stages apply to every task | Schema checks and gates between stages |
| Parallel specialists | Subtasks are independent and can improve speed or coverage | Deduplication, conflict rules, and a shared synthesis schema |
| Orchestrator-workers | Necessary subtasks emerge from the specific assignment | Depth, worker, turn, retry, time, and cost budgets |
| Evaluator-optimizer | A clear rubric makes iterative revision measurably better | Maximum loops and independent completion criteria |
How to design a bounded orchestration run
Build the run as a sequence of contracts and checks. Every delegation should have a reason and a finite return shape.
- 01
Establish the single-assistant baseline
Outcome: A measured reason to add specialization.
- Run representative tasks with one capable assistant.
- Classify failures by instructions, context, tools, or workload shape.
- 02
Define the lead contract
Outcome: One owner for clarification, routing, synthesis, and completion.
- Specify acceptance criteria before delegation.
- Prevent silent goal expansion.
- 03
Define specialist envelopes
Outcome: Distinct subtasks with minimal context and structured returns.
- Assign non-overlapping expertise or independent work.
- Require sources, assumptions, blockers, and confidence.
- 04
Add budgets, gates, and approvals
Outcome: A finite graph with controlled authority.
- Cap specialists, turns, retries, elapsed time, and cost.
- Gate external writes and sensitive data access.
- 05
Evaluate and monitor the whole run
Outcome: Outcome and trace evidence for reliability, cost, and risk.
- Compare against the single-assistant baseline.
- Promote stable cases into a continuous regression suite.
Prompts you can use
Replace the bracketed details, attach the relevant source material, and keep the review step in the same workspace.
Architecture decision
Prompt 01Evaluate whether this task needs one assistant, routing, a fixed workflow, parallel specialists, orchestrator-workers, or evaluator-optimizer. Identify the measured limitation each added component solves and estimate the added latency, cost, and failure surface.
Why it works: It requires every orchestration layer to justify itself.
Delegation envelope
Prompt 02Create a specialist task envelope containing the parent goal, exact subtask, immutable constraints, allowed context, allowed tools, budget, output schema, evidence requirements, prohibited actions, and success or failure return states.
Why it works: It prevents vague handoffs and context drift.
Synthesis audit
Prompt 03Audit this multi-agent synthesis. Map each material claim to its specialist and source, detect duplicated evidence, reconcile units and dates, preserve unresolved conflicts, verify completion criteria, and flag any tool call or subtask outside the approved plan.
Why it works: It checks both evidentiary quality and authorization.
Editorial method
How this guide was prepared
This architecture guide synthesizes current primary pattern guidance from OpenAI and Anthropic with NIST- and OWASP-aligned control principles. The Kona section was checked against implemented routing limits, direct selection, @mentions, capability declarations, run records, verification, and approval behavior on August 11, 2026.
Read Kona’s editorial standardsSources
Sources and benchmarks
01
02
Building effective agentsAnthropic · 2024-12-19
03
Demystifying evals for AI agentsAnthropic · 2026-01-09
04
Trustworthy agents in practiceAnthropic
05
Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence ProfileNational Institute of Standards and Technology · 2024-07-26
06
Agentic AI threats and mitigationsOWASP GenAI Security Project
07
Creating helpful, reliable, people-first contentGoogle Search Central
08
Configurable AI assistants for business workKona Business AI
09
AI business planning workspaceKona Business AI
10
AI data governance and metric opsKona Business AI
11
Data connectors and analytics platformKona Business AI