Hercules

ImproveIssues

Improve

Agent issues

Issues is your to-do list of problems Auto-improve found in your Agent's runs. Each one says what's going wrong and suggests a fix.

Go to Agent → open an Agent → Improve → Issues.

What's on an issue?

FieldWhat it means
SeverityHow serious it is: Critical, High, Medium, or Low
StatusOpen, Acknowledged, Applied, or Dismissed
Last seenThe most recent run where this happened
EvidenceThe runs Auto-improve read to reach this conclusion
Proposed fixesWhat to change, see below
ActivityComments from your team, plus a record of every change made

How do I work through the list?

Search the list, or use the two buttons beside the search box:

  • Filter (the funnel) picks which statuses and which severity are listed. The button shows a count while a filter is on. Click Clear filters to go back to the list you started with.
  • Display (the sliders) groups the list by Severity or Status, or turns grouping off. It also orders the list by how often an issue happens, how serious it is, when it was last updated or last seen, or by title.

The list opens on Open and Acknowledged issues, the ones that still need work. To see the rest, open Filter and turn on Applied and Dismissed, or All.

Start with Critical and High, grouped by severity.

How do I apply a fix?

Open the issue and apply the fix. An issue can suggest more than one, and they come in a few shapes:

  • An instructions change, shown side by side with your current instructions
  • A test case to add, so the same problem gets caught by an evaluation next time
  • A scorer to add, for the same reason
  • Something for you to do yourself, outside the Agent, which you then Mark as done. Each one says what it's about: knowledge base, tool, integration, or other

Read the change before you apply it. If you've edited the Agent since the fix was written, Hercules warns you that applying it will overwrite your newer instructions.

Can I change how serious an issue is?

Yes. Set your own severity on the issue. Yours wins everywhere the issue appears, and the change is recorded in the activity log.

Can the Agent see its own issues?

Only if you let it. Go to Manage → Agent settings → Issue access:

SettingWhat the Agent can do
NoneNothing. It can't see its issues
ReadRead its issues, and report a problem it notices while working. Reports are reviewed before they reach your list
Read and writeEverything in Read, plus changing an issue's status and severity, including closing one it thinks is fixed

Issue access is part of the Agent, so changing it creates a draft you'll need to publish.

Additional FAQ

Why does the issue count end in a plus?

The list loads a page at a time, so the count is what's loaded so far. A trailing + means there's more.

What does Dismissed do?

It takes the issue off your list without changing anything. Use it for things that aren't really problems, then add the reason to the extra context box on Auto-improve so it stops reporting them.

Where do issues come from?

From Auto-improve analyses, and from the Agent itself when Issue access allows it.

Can my teammates see issues?

Yes. Agents belong to your Organization, and everyone in it sees the same issues and comments.

Can I edit or delete a comment?

Yes, if you wrote it. Hover over the comment and open its menu. Deleting asks you to confirm first, because a deleted comment can't be brought back.

Will a fixed issue come back?

No. Applied and dismissed issues are closed for good. If the same problem happens again, it turns up as a fresh issue.