Skip to main content
// fractional AI lead

Hermes Agent setup — done by a real person, not a tutorial_

Hermes Agent is the open-source autonomous agent framework with more than 188,000 stars on GitHub, and the most popular way to get an AI to actually do multi-step work without holding its hand. It is also the most popular way to spend a weekend watching an agent loop forever, call the same tool with the same arguments seventeen times, and quietly drain an API budget. I set it up so it does work, then stops.

What Hermes Agent is, why people get stuck

An autonomous agent framework is scaffolding. The interesting decisions are all yours.

Hermes Agent gives you three components in one repo: a planning loop that lets a model decide what to do next, a tool-use interface for registering functions the agent can call, and a memory layer for what the agent remembers between steps. Out of the box, you can clone it, plug in an API key, and watch an agent attempt a task. That demo works in about ten minutes. Production use is a different problem.

The production problem is that every interesting question about how the agent behaves is a configuration decision. Which model runs the planning step. Which model picks tools. What tools exist and how they describe themselves to the model. Where memory lives. When the loop stops. How much an individual run is allowed to cost. What the agent does when it gets confused. None of those have a single right answer. All of them have wrong answers that cost money or break trust.

A real Hermes Agent setup is the work of making those decisions deliberately — once, with reasons, written down — so the agent runs predictably and you stop hovering over it. After that, you can hand it actual tasks and walk away. If you want to see how Hermes Agent fits next to other agent stacks, the services page covers the lineup. If you are past comparison shopping and just need it to work, keep reading.

Where Hermes Agent breaks for most people

Seven failure modes I see every week

These are the patterns behind almost every "my agent is not working" message. They are not bugs in the framework. They are decisions that were never made.

1. The agent loops forever

The default loop runs until the model declares the task done. When the model gets confused, the loop runs until something else stops it — which without explicit guards is "your API budget." The fix is a layered set of stopping conditions: a maximum step count, a token budget per task, a wall-clock timeout, and a repeated-state detector that halts when the agent calls the same tool with the same arguments twice in a row.

2. Model selection is wrong for the loop phase

Using a frontier model for every step is a budget fire. Using a small model on planning is a quality fire. The right setup splits roles — frontier for plans and hard reasoning, cheaper for routine tool selection, fast and small for ranking or filtering. Hermes Agent supports per-phase model overrides. Almost nobody uses them.

3. Tool registrations are thin

The framework expects tools to declare name, description, input schema, and function. Most setups stop at name and function. The model then either ignores your tools or calls them with bad arguments. A real registration treats the description like docs for the model and the schema like a real contract — required fields, clear types, examples in the description. The agent gets dramatically better the moment you fix this.

4. No memory store, or the wrong one

Hermes Agent does not pick a memory store for you. People either skip memory entirely and watch the agent forget the task halfway through, or they wire a heavyweight vector store for a workflow that needed five lines of in-process state. The right memory layer matches the task — in-memory for short tasks, a real vector store for cross-session recall, a shared store for team workflows.

5. There is no cost cap

A runaway agent on a frontier model can spend more in an hour than a developer makes in a day. The default config has no provider-level cap, no per-task budget, no alert when a single run crosses a threshold. The fix is layered — provider account cap, per-task token budget, real-time spend observability. None of this is free to set up. All of it is non-optional for production.

6. The agent runs without observability

People run Hermes Agent like a black box and then cannot explain why it did what it did. The fix is logging every step — the model used, the prompt, the tools considered, the tool called, the arguments, the return value, the token spend — and writing it somewhere you can search later. The first time an agent does something surprising in production, observability is the only thing standing between you and a rewrite.

7. No human-in-the-loop for risky actions

Autonomous does not mean unsupervised. Any tool that mutates state outside the agent — sends an email, writes to a database, posts to a public channel, hits a paid API — should require explicit approval until you trust the agent on that exact action. The framework supports this. The default does not enforce it. I configure the policy explicitly and document which tools are auto and which need approval.

What I actually set up

What is in the box when I hand Hermes Agent back to you

Every Hermes Agent setup I do covers the same core checklist and adapts to your use case. The output is a checked-in configuration, real tool definitions, a memory layer fit to your workflow, and a short doc explaining how every piece fits together.

Loop guards on every run

A maximum step count, a token budget per task, a wall-clock timeout, and a repeated-state detector. The agent stops when something has gone wrong, not when the budget runs out.

Model routing per loop phase

Frontier for planning and hard reasoning, balanced for routine tool selection, fast small for filtering and ranking. Anthropic, OpenAI, or a mix. A hard provider-level cost cap behind all of it.

Real tool registrations

Each tool documented for the model — a description that names the cases where it helps, an input schema with required fields and clear types, examples where they matter. Written with you so the descriptions reflect what your tools actually do.

Memory store fit to the use case

In-memory for short-lived tasks, a vector store for cross-session recall, a shared store for team workflows. Embedded notes, scoped retrieval, and a clear write policy so the agent does not pollute its own memory.

Approval policy for risky tools

Read-only tools auto-approved, write actions explicit by default, paid-API calls explicit until trust is earned. Written down so nobody has to guess what the agent is allowed to do.

Observability and cost monitoring

Every step logged — model, prompt, tools considered, tool called, arguments, return, token spend. A weekly readout of cost per task type so you can see early when an agent is drifting.

A real first task

Setup is not done until the agent runs an actual workflow you care about, end to end, twice in a row. Demos are easy. Real tasks reveal everything the demo hid. We run yours and fix what the run uncovers before I hand it over.

Shapes of engagement

Three shapes for getting Hermes Agent dialed in

The duck quotes the work, not the menu. These are the three shapes a Hermes Agent engagement usually fits.

Quick fix

One specific Hermes Agent problem, fixed in a day. The loop will not stop, a tool is failing silently, the memory store is wrong, a runaway burned through the budget. You describe the symptom, the duck scopes it, I fix it. Single deliverable, one calendar day.

Tuneup

Your personal Hermes Agent workflow, dialed in over about a week. Loop guards, model routing, tool registrations, memory store, approval policy, cost monitoring, a real first task running cleanly end to end. You end with a setup that works on the task you actually care about and a short doc explaining what every piece does.

Workspace

Your team on Hermes Agent, configured consistently. Shared configuration repo, shared tool definitions, a shared memory store with a clear write policy, an approval policy your team agrees with, and a thirty-minute walkthrough so the people who will run agents at 2am know what they are looking at. One to two weeks, depending on team size.

Not sure which shape fits? Tell the duck what is breaking and how many people are affected. The duck names a shape and a price in plain English on the call.

FAQ

Questions people ask before booking

What is Hermes Agent?

+

Hermes Agent is an open-source autonomous agent framework — one of the most-starred AI agent projects on GitHub, north of 188,000 stars as of mid-2026. It gives you the scaffolding for multi-step task execution: a planning loop, a tool-use interface, a memory store, and the glue to keep all three talking. You bring the model, the tools, and the goal. The framework runs the loop. The catch is that everything interesting about an autonomous agent — what model it uses, what tools it can call, what it remembers between steps, when it gives up — is configuration, not default behavior.

Why does my Hermes Agent keep looping forever?

+

Almost always because no real stopping condition was wired in. The default loop runs until the model says it is done, which is fine in theory and disastrous in practice when the model gets confused. The fix is layered guards — a hard maximum step count, a token-budget ceiling, a per-task timeout, and a detector for repeated-state loops where the agent keeps calling the same tool with the same arguments. I configure all four on every Hermes Agent setup. None of them are in the default config.

Which model should I run Hermes Agent on?

+

Depends on the work, but the honest answer for most setups is: a frontier model for the planning step, a cheaper model for routine tool selection, and never the same model for both. Running the frontier model on every step is how people end up with surprise bills. Running a small model on planning is how people end up with agents that spin uselessly. A real setup splits the roles. I configure the model routing per loop phase and put a hard monthly budget cap behind the whole thing.

How do I register custom tools with Hermes Agent?

+

The framework expects each tool to declare a name, a description that the model actually reads, an input schema, and a function. Most setups stop at name and function and skip the rest. The result is an agent that does not know when to call your tools, or calls them with bad arguments. A real tool registration is more like writing API docs for the model — a description that names the cases where the tool helps, an input schema with required fields and clear types, and a return value the model can use in the next step. I write the registrations with you on every setup.

What memory store should I use?

+

Hermes Agent does not enforce one — that is on you to wire. The right answer depends on what you need the agent to remember and for how long. For short-lived task memory, in-process state is fine. For cross-session memory, you want a vector store with the agent's notes embedded so it can recall related context on future runs. For shared team memory, that vector store has to be hosted somewhere the team can both write to and read from. I match the memory store to the use case, not the other way around.

How do I stop the agent from burning through my API budget?

+

Three controls, all of which are off by default. First, a token budget per task — when the agent crosses it, the loop halts and asks for human input. Second, a global monthly cap on the API account itself, set at the provider level so even a runaway cannot exceed it. Third, observability — a real log of token usage per step so you can see in advance when an agent is heading off the rails. I configure all three and write a short doc so the team knows where to look when costs surprise them.

Is Hermes Agent production-ready?

+

It is open-source code, not a managed product. Production-ready depends entirely on how you configure it. With model routing, real tool registrations, a memory store fit to your use case, loop guards, observability, and cost caps, Hermes Agent can run real autonomous workflows in production. Without those, it is a research toy that will eventually do something expensive. The whole point of a setup engagement is to get you to the first state, not the second.

// Ask the duck

Bring the task you want the agent to do. I will tell you what to wire.

The first call is honest. Sometimes the answer is "your loop guards are missing, here is the fix, do not pay me." Sometimes it is "this is a one-day Quick fix." Sometimes it is "your team needs a Workspace and here is the timeline." Running a production autonomous agent is exactly the kind of thing that benefits from an ongoing fractional AI lead — someone watching costs, model updates, and tool-reliability month to month so you do not. Either way you leave with a clearer picture of what the agent is missing and what a real production setup would look like. Open the duck and start there.