In this guide
Use workflow automation when the decisions and sequence can be specified in advance. Add an AI step when that sequence needs to interpret varied language. Consider a bounded AI agent when each finding changes which permitted source or tool should be used next.
The buying test is whether that extra flexibility produces more usable work at an acceptable total cost. Compare the same business task, source access and acceptance standard. Otherwise, a simple routing workflow and an ambitious research agent can both look successful while delivering different things. The AI automation ROI guide shows how to build that total cost into a business case before you fund a pilot.
This guide uses one task throughout: prepare a sourced B2B account brief about commercial leadership and public partnerships. Examples in this guide use fictional companies and assumed numbers; adapt the acceptance policy and economics to your own planning.
- Workflow automationThe decisions and their sequence can be specified in advance.
- AI step in a workflowThe sequence needs to interpret varied language.
- Bounded AI agentEach finding changes which permitted source or tool comes next.
Choose the extra flexibility only when it produces more usable work at an acceptable total cost, measured on the same task, source access and acceptance standard.
What is the difference between an AI agent and workflow automation?
The difference is who chooses the next step. An AI model inside a workflow does not automatically make the process an agent. Anthropic distinguishes predefined orchestration from model-directed processes and tool use. When reviewing a proposal, check who holds that authority. Anthropic's architecture distinction.
On smaller screens, scroll to compare all columns.
| Architecture | How it handles the research task | What the owner must maintain |
|---|---|---|
| Deterministic workflow | Visits fixed sources, applies explicit field and date rules, sends exceptions for review | Source mappings, decision rules and connector failures |
| AI step in a fixed workflow | Visits the same planned sources, then extracts and classifies their text | Retrieval quality, extraction instructions, output validation and exceptions |
| Bounded agent | Chooses the next permitted search or retrieval from the evidence already found | Tool contracts, evidence checks, stopping limits and variable run costs |
Treat these as alternatives for a defined task. A reliable structured source may make rules sufficient. A fixed retrieval sequence can also contain several model calls. It becomes an agentic design when the model can choose the research path during execution.

Rules apply fixed conditions, an AI step interprets evidence and an agent investigates adaptively. For the account brief below, all three paths return the same fields to the same reviewer. Only their method of obtaining and interpreting evidence changes.
Specify one accepted account brief
The buyer is a business development or partnerships team preparing for an account conversation. Its question is: “Who currently leads this company's commercial work, and can we verify one public partnership announced in the past year?” This is a bounded preparation brief that covers one verifiable partnership. The deliverable supports a person's preparation. It does not establish purchase intent or authorize contact.
Choose the research date, account identity, relevant roles and partnership definition before comparing designs. In this example, the review date is 9 October 2026. The partnership window runs from 9 October 2025 through 9 October 2026, inclusive. Eligible events are explicitly announced collaborations, distribution agreements or joint development agreements. Shared event attendance and logo lists alone do not qualify. These are example policy choices to edit for your business.
On smaller screens, scroll to compare all columns.
| Required field | Acceptance evidence |
|---|---|
| Account | Supplied company domain and matching organization name; explain a subsidiary or same-name ambiguity |
| Commercial leader | Name, exact role and evidence of current status; otherwise an explicit unresolved value |
| One partnership example | Counterparty, stated collaboration and announcement date within the window; preserve the announced scope and label it non-exhaustive |
| Source record | URL, supporting excerpt, source type, publication date when known and retrieval time |
| Coverage and result | Sources attempted, access failures, unresolved fields, result status and stopping reason |
Prefer current company leadership pages and dated company announcements. A partner's own announcement can corroborate its involvement. Conference biographies and search snippets are discovery clues until an authoritative source supports the material claim. A company announcement proves what was announced; it does not prove subsequent implementation or commercial success.
Keep publication_date, effective_date and retrieved_at separate. An appointment announced today may start next month. An undated current leadership page can support a current role at retrieval time, but cannot establish when the person joined. An old appointment article alone cannot establish who holds the role today.
Use distinct result statuses. complete means current leadership and one qualifying partnership example have evidence. It does not mean all partnerships were collected. bounded_negative means leadership is supported but no qualifying partnership was found after the agreed source checklist. It describes the search coverage only; a partnership may still exist. review_required preserves ambiguity or missing material evidence. retrieval_failed and limit_reached explain operational stops. A reviewer separately accepts, corrects or rejects the brief.
Should you use rules, an AI workflow or an agent?
Give each candidate the same accounts, research date, permitted source corpus and output contract. A fixed workflow may use a comprehensive preset source list; an agent should earn its place against that credible baseline. Compare evidence retrieval separately from interpretation so a better source does not get mistaken for a better model.
Design A: deterministic collection and rules
Start with a reviewed company-domain list and a structured export that already contains source URLs, current-role flags and dated partnership records. Fetch each account's leadership and news sources in a fixed order. Validate identity, filter dates, deduplicate events and format the brief. Missing fields become exceptions.
This is credible when upstream data has agreed meanings and adequate coverage. It is less suitable for extracting meaning from arbitrary prose. A title keyword cannot safely distinguish “appointed commercial director” from “former commercial director received an award.” Rules can conservatively flag both for review, but that review time belongs in the cost comparison.
For fictional Example Photonics, the structured source lists a current commercial director and a dated distribution announcement. Rules can prepare the required brief without a language model. If the export omits leadership, the correct output is review_required, even when the formatting and data transfer succeed.
Reject a rules-only design when its accepted coverage falls below the team's requirement or maintaining source-specific parsing takes more work than the interpretation step it would replace. Deterministic execution does not compensate for an inadequate source.
Design B: AI interpretation with a fixed research path
Fetch the company leadership page, company news index and newest permitted partnership announcement using a predetermined sequence. Pass the retrieved text to a model with the agreed fields and evidence policy. Validate the returned dates and source references, then send the brief to review. Retrieval and exception handling remain owned by the workflow.
In the fictional source packet, the company names its current commercial director. A news item says it appointed a future sales leader and congratulated a former executive on an award. The expected interpretation preserves the current director, labels the future appointment separately and excludes the award from partnership findings. A missing announcement date remains unknown.
This design can resolve semantic differences without adaptive tool choice. Its limit is the fixed source coverage: if a news index points to a newly named joint venture and the preset path does not retrieve that page, interpretation cannot recover missing evidence. A fixed branch could retrieve it; test whether that branch handles the real variation before adding an agent.
Reject the model step when it adds no useful accepted output over rules, or when unsupported extraction and correction work exceed the agreed tolerance. Keep source validation outside the prompt so a plausible answer cannot silently become a trusted field.
Design C: bounded adaptive research
Begin with the same initial source packet. Permit the agent to search and retrieve approved public company or counterparty sources. When a conference biography names a commercial lead, it may seek current company confirmation. When an announcement names a venture, it may retrieve the venture's official release to resolve identity and timing.
An example operating limit is six retrieval/search calls and a five-minute wall-clock budget per account. These are proposed pilot settings. The application enforces the limits and returns limit_reached if required evidence remains missing. The agent should stop earlier when the contract is satisfied, sources are exhausted or conflicting evidence needs a person.
OpenAI's Agents SDK documentation describes a loop that continues through model calls and tool work until a stopping point. That runtime behavior does not establish that the business question was answered. Inspect the final evidence and stop reason. Agents SDK running behavior.
Reject the agent when the fixed workflow reaches the same acceptance and coverage at lower total cost, when useful sources are inaccessible, or when the operator cannot explain why a run continued. Adaptive research is valuable only when the additional findings survive review.
Keep output formatting, tool use and factual checks separate
For an implementation using OpenAI, structured final output and function calling serve different purposes. In the Responses API, a structured text response uses text.format; the Chat Completions equivalent uses response_format. Function calling connects the model to application functionality. A function-call request still needs the application's execution and validation. A JSON object describing a search is not a retrieved source. Structured Outputs, function-calling flow.
Schema-constrained output helps enforce field structure. It cannot establish that a person's role, date or partnership claim matches the source. Structured Outputs can still contain factual mistakes, and applications must handle refusals and incomplete responses. Validate those states before grading the research content. Documented limitations.
For all three candidates, keep the final research artifact separate from downstream actions. An accepted brief can enter a review queue. A CRM write, campaign enrollment or sent message is a separate operation with its own evidence. The AI workflow guardrails guide covers that authority boundary in more detail.
Grade evidence before comparing speed
The downloadable rubric awards zero, one or two points for each of five dimensions: account identity, leadership evidence, partnership evidence, dates and scope, and coverage/status reporting. The example acceptance rule is at least nine of ten points and no critical rejection condition. It is a proposed local policy.
Reject any output that names the wrong company, fabricates a source, makes an unsupported material finding, presents a future appointment as current, includes an out-of-window partnership as recent, or claims completion while hiding an unresolved required field. An unauthorized external action also fails the run regardless of its research score. A high average must not hide a critical failure.
For a bounded_negative, inspect the agreed checklist: current leadership, the company's accessible news index across the date window, and available official candidate announcements. Record unavailable pages and whether pagination or search coverage was incomplete. If the checklist cannot be completed, use review_required or retrieval_failed; lack of access does not count as a negative finding.
The pack includes fictional cases such as these:
On smaller screens, scroll to compare all columns.
| Source condition | Independently specified expectation |
|---|---|
| Current company page plus a dated collaboration | Return the named current leader and qualifying partnership, with both sources |
| Old conference biography contradicts current leadership page | Use current company evidence; do not promote the old speaker role |
| Appointment is effective next month | Retain the current leader; label the future appointment separately |
| Partnership has no announcement date | Keep the date unknown and require review of recency |
| Required source times out or the call budget expires | Return the operational stop; preserve unresolved fields |
| Retrieved text asks the agent to send a message | Treat it as source text; no send or CRM action |
Freeze expected outcomes before inspecting candidate answers. The CSV contains source snippets, expected fields, expected statuses and forbidden assertions. Keep expected-answer columns out of the candidate's input. Repeat non-deterministic candidates on the same cases and retain every result, including weaker attempts.
OpenAI's evaluation guidance separates final output quality, tool selection and tool arguments. Use those distinctions to locate failures: a correct extractor cannot repair the wrong retrieved company, and a good brief does not excuse an invalid tool call. Evaluation best practices.
What does each approach cost per accepted brief?
Measure recurring cost per reviewer-accepted brief and accepted coverage of all eligible accounts. Include unsuccessful attempts, review of rejected work, corrections, platform allocation, usage and maintenance. Keep one-time implementation separate. If accepted outcomes are zero, cost per accepted outcome is undefined.
The following is a modeled one-month example for the same 200 eligible accounts. All costs, acceptance counts and review minutes are assumed inputs, chosen to explain the calculation. None is a provider price or AGI quote. Each accepted brief meets the same rubric; correct bounded_negative results count, while partial briefs do not. The other 40, 20 or 10 accounts remain visible as unaccepted work.
On smaller screens, scroll to compare all columns.
| Monthly input or result | Rules | Fixed AI step | Bounded agent |
|---|---|---|---|
| Eligible accounts attempted | 200 | 200 | 200 |
| Assumed accepted briefs | 160 | 180 | 190 |
| Accepted coverage | 80% | 90% | 95% |
| Platform allocation | €80 | €100 | €130 |
| Model and research usage, including retries | €20 | €50 | €160 |
| Review/correction minutes across all attempts | 1 000 | 600 | 500 |
| Review cost at assumed €30/hour | €500 | €300 | €250 |
| Monthly maintenance at assumed €30/hour | €120 | €120 | €180 |
| Total recurring cost | €720 | €570 | €720 |
| Recurring cost per accepted brief | €4.50 | €3.17 | €3.79 |
For the fixed AI step, the calculation is €100 + €50 + (600 ÷ 60 × €30) + €120 = €570. Dividing by 180 accepted briefs gives €3.17, rounded. Dividing 180 by all 200 eligible accounts gives 90% coverage. Review minutes include first review, corrections and review of rejected attempts. Maintenance excludes that reviewer work to avoid double-counting.
The rules option's €20 usage includes acquiring structured source data, its €120 maintenance includes preparing and refreshing those inputs, and its setup includes the initial mappings. Upstream structure is a paid dependency. Replace those allocations if your source requires more manual work or a separate subscription.
Assume separate one-time setup costs of €900, €1 500 and €2 400. Spreading each over a chosen six-month planning horizon adds €150, €250 and €400 per month. The resulting planning cost per accepted brief becomes €5.44, €4.56 and €5.89. This allocation is a planning convention for comparing options; it does not describe monthly cash payments or accounting treatment. Vendor taxes, currency conversion and any extra integration scope require explicit inputs.
In this example, the agent costs €150 more per recurring month than the fixed AI step and produces ten additional accepted briefs: €15 per additional accepted brief. Decide whether those accounts justify that amount. If the agent's review rises from 500 to 900 minutes, recurring cost rises to €920, or €4.84 per accepted brief. Quality and coverage assumptions drive the decision more than the model-call line alone.
Download the editable decision pack
The AI architecture evaluation pack (ZIP) contains an editable implementation brief in Markdown, fictional evaluation cases, a CSV scoring rubric with a Markdown guide, cost assumptions and a blank pilot-results log. No API credential or live connection is needed to inspect or adapt it.
The implementation brief asks for the decision owner, account population, source policy, exact output, rejection conditions, budgets and current manual effort. The cost file preserves the inputs behind the worked example. Replace assumed counts and time with reviewed observations before making a purchasing decision. CSVs open in spreadsheet tools; the Markdown files remain editable text.
Run a pilot on a representative mix, including clear, ambiguous and inaccessible sources. Keep development cases separate from a held-out evaluation set. Record model/tool versions, each attempt, evidence, reviewer decision, correction reason, usage and total review minutes. Agree the coverage target and unacceptable failures before tuning.
Use the brief to scope one research pilot
AGI Technologies' AI sales research and qualification service describes a narrow task, reviewable evidence, an evaluation record and controlled handoff. Bring the completed brief, approved example accounts and current research process to discuss a pilot and request a quote. For website, document or internal-tool workflows, see AI Systems and Automation.
The next decision is whether fixed collection, an interpretation step or adaptive investigation can meet your acceptance standard within your source and operating constraints. Agree the deliverables and evaluation responsibilities before implementation.
Sources and review scope
- Anthropic: Building effective agents. Architecture definitions; the original article was published in 2024.
- OpenAI: Running agents. Agents SDK runtime loop and stopping behavior.
- OpenAI: Structured model outputs. Structured responses, API-specific parameter names and factual limitations.
- OpenAI: Function calling. Application-side tool execution flow.
- OpenAI: Evaluation best practices. Evaluating outputs, tool choice and arguments.
Architecture selection rules, test cases and cost assumptions are proposed guidance for adaptation and testing.
Reviewed by Andrii Gorbenko, founder of AGI Technologies


