BlueBear Insights · Agent Architecture · 9 min read

Enterprise AI Agent Platform Architecture: A Practical Reference Model

BlueBear integration catalog interface
Existing BlueBear product evidence: the integration catalog used to connect governed agent workflows.
A walkthrough of the existing BlueBear platform workspace.

Disclosure: BlueBear sells a platform that is one of the buy options, so we have a commercial interest. That is a direct conflict on this topic, so the article is written as the questions to ask rather than a recommendation, and it names what any platform including ours cannot do for you.

Feature comparison is the wrong first move

Build-or-buy usually starts as a feature matrix. That comparison is not useless, but it answers a later question. The first question is which responsibilities stay with you regardless, because those determine what you are actually choosing between.

If you are putting AI in front of your own staff or customers on infrastructure you already run, you have a specific advantage and a specific constraint: the systems already exist, with their own identity model, data boundaries and change control. The decision is less about capability than about which layer you want to own.

What is genuinely commodity

Some parts are the same for everyone, hard to get right, and carry no competitive value. Session and conversation state. The plumbing of a tool protocol. Model routing and fallback. Retry and idempotency mechanics. Streaming and cancellation.

Each of these has a long tail of edge cases that takes months to discover, and none of them will differentiate you. This is the honest case for buying, and it does not depend on any particular vendor.

What is not commodity, even though it looks like it

The policy layer encodes how your business works. Which systems each agent may reach, and under what conditions. What triggers a human check. What counts as an acceptable outcome. How outcomes are measured.

These look like configuration and behave like business logic. A platform that ships defaults for them is making decisions on your behalf, and the defaults are chosen for the median customer. Where you differ from the median is exactly where the default is wrong.

The four that stay yours either way

Who the agent acts as

A platform can enforce identity. It cannot decide what a given agent should be allowed to reach in your estate, because that depends on your systems and your risk position. Buying does not remove this work; it changes where you express it.

Where data is allowed to sit

Which regions, which stores, what leaves the boundary and what may not. Running on your own infrastructure is usually the reason this decision was made already - and it is the one most likely to be quietly violated by a platform's telemetry or model routing.

What needs a human

A platform can implement approval gates. Deciding which actions deserve one is a judgement about reversibility and consequence in your business. Nobody outside it can make that call, and a default that gates everything produces a queue nobody reads.

How long evidence is kept

Retention is set by your obligations, not by a product's defaults. This is also the sharpest lock-in test: if your evidence is only queryable through a vendor console, your audit position depends on a commercial relationship.

Four questions that decide the shape

  • Which of the four above have you actually decided? If any are undecided, no vendor comparison will resolve it, and buying will decide it for you by default.
  • Can evidence, integration definitions and policy be exported in a form you can read without the vendor? If not, switching cost includes your audit position.
  • Does the platform assume it owns the identity model, or can it act within yours? On existing infrastructure this is usually the hardest integration point and the least discussed in a demo.
  • What happens to running agents when the platform is unavailable? Stopping is defensible. Continuing without policy enforcement is the answer you want to discover now rather than during an incident.

The shape most operators land on

Buy the runtime and the protocol plumbing, own the policy and the evidence, and insist both are exportable. That keeps the six months of edge cases off your roadmap while leaving the decisions that encode your business - and the accountability that comes with them - where they have to sit anyway.

What changes at the second agent

The build-or-buy question feels different with one agent than with several, and the shift catches teams out because nothing announces it.

With one agent, everything is tractable in-house. Identity is a credential, policy is an if-statement, evidence is a table. The scaffolding is small enough that building it looks obviously cheaper than buying.

At the second and third, the same four responsibilities stop being per-agent decisions and become shared infrastructure. Two agents reaching the same system need consistent identity, or you cannot tell their actions apart. Two agents with different approval thresholds need those thresholds expressed somewhere both respect. Evidence from both has to land in one place or you cannot answer a question that spans them.

That transition is where in-house scaffolding either becomes a platform or becomes technical debt, and it usually arrives before anyone has decided which.

The question that actually decides it

Not "can we build this" - you can. It is whether the agent layer is something you want to be maintaining in two years.

The plumbing does not stay still. Protocols change, providers deprecate parameters, model behaviour shifts under you, and every one of those is a change you absorb rather than choose. If nobody is going to own that ongoing work, building is not cheaper; it is deferred cost with no owner.

Conversely, if agents are close to your product rather than internal tooling, the policy layer probably is differentiating and you will want it in your own codebase regardless of what runs underneath.

A reasonable default

Buy the runtime, own the policy and the evidence, and insist both are exportable in a format you can read without the vendor.

That gives you the six months of protocol edge cases for free, keeps the decisions that encode your business where they belong, and leaves the exit affordable. It is not the cheapest option on day one, and it is usually the cheapest by the time you have four agents and somebody asks what one of them did last quarter.

Questions people actually search for

should we build or buy an ai agent platform

Buy the parts that are the same for everyone and build the parts that encode your business. Session handling, tool protocol plumbing, model routing and retry logic are commodity - they are hard to get right and identical across companies. Your approval thresholds, what counts as an acceptable outcome, and which systems an agent may touch are not commodity, because they encode decisions only you can make. The mistake is buying something that assumes those for you.

what does an ai agent platform not do for you

Four things stay yours whichever way you go: deciding what identity an agent acts as and what it may reach, deciding where data is allowed to sit and leave, deciding which actions require a human, and deciding how long evidence is kept. A platform can enforce all four. None of them can decide them for you, and the accountability for the decision does not transfer with the purchase.

what should you build yourself for ai agents on your own infrastructure

The policy layer, not the plumbing. Which systems each agent may reach, what triggers a human check, what an acceptable result looks like, and how outcomes are measured - these encode how your business works and are rarely portable. Building session management or protocol handling from scratch is usually a way of spending six months arriving at what already exists.

how do you avoid lock-in with an ai agent platform

Check that three things leave with you: the evidence records in a format you can read without the vendor, the integration definitions describing what each agent may reach, and the policy configuration. If those are exportable, switching costs engineering time. If evidence is only queryable through the vendor console, you have handed over your audit position along with the workload.

Primary sources