In addition to mapping tool invocations to agent records, allowing Atryum to use agent-scoped rules (Rules), and powering invocation summarization (Invocations), the ValidMind integration also allows you to use Atryum to evaluate tool invocations against each agent's charter:
- A charter is a plain-language policy that describes what an agent can do, what it cannot do, and which actions require human approval.
- Charters can be as terse or expressive as you would like. It's good to call out specifics when you can but be sure to include general statements to give the LLM something to hold on to when seeing an unanticipated tool call.
- Use our provided
populate-charterskill to help you author effective charters.
Prerequisites
Before connecting Atryum to ValidMind:
- Set up a ValidMind record type for AI agents if one does not already exist. (Manage inventory record types)
- Add a custom long text field to that record type for each agent's charter. (Manage inventory fields)
- Create at least one record in that record type and fill in its charter field. (Register records in the inventory)
- Make sure you have valid ValidMind API and secret keys for the organization you want Atryum to connect to. (Manage your profile)
Connect Atryum to ValidMind
- Set up ValidMind for Atryum:
./atryum setup validmind - Follow the prompts and enter your:
- ValidMind Base URL — The URL for the ValidMind organization you want Atryum to connect to. For example:
https://app.prod.validmind.ai/ - ValidMind API key — Your organization API Key.
- ValidMind API secret — Your organization Secret Key.
- ValidMind Base URL — The URL for the ValidMind organization you want Atryum to connect to. For example:
- Atryum prints the path to your updated
atryum.tomlconfiguration file. Open the file and verify that it has been edited with your submitted values:- On macOS, this is typically under
~/Library/Application Support/atryum/atryum.toml. - On Linux, this is typically under
~/.config/atryum/atryum.toml.
- On macOS, this is typically under
- Restart Atryum so it loads the updated ValidMind credentials:
a. In the terminal where Atryum is running, press
Ctrl+Cto stop it. b. Start Atryum again:./atryum run --init-servers - Within Atryum, click Settings in the left sidebar.
- Under Agent Record Sync, select the:
- ValidMind Organization — The ValidMind organization to sync records from.
- Organization Record Type — The record type that identifies your agent records.
- Charter Field — The custom long text field that stores each agent's policy.
- Click Save Settings to apply your changes.
Set up ValidMind AI evaluation rules
Create a rule in Atryum to evaluate matching tool invocations against the synced ValidMind agent's charter:
- In Atryum, click Rules in the left sidebar.
- Click New Rule.
- Under Action, select
AI Evaluation. - Under Evaluation Model, select the ValidMind model configuration to use for the evaluation.
- Under Agents, select the synced ValidMind agent records you want this rule to apply to. Leave this empty to match all agents.
- Under Servers / Sources, select the servers or sources the rule should apply to. Leave this empty to match all servers.
- Under Tools, select the tools the rule should apply to. Leave this empty to match all tools.
- (Optional) Enter a Description so you can remember why the rule exists.
- Make sure that Enabled is checked, then click Create Rule.
- When a matching tool call arrives, Atryum sends the call and the agent's charter to the ValidMind evaluation model. The model returns a verdict for the invocation — approve, deny, escalate to a human, or defer to the next rule.
- If Atryum cannot resolve the agent or its charter, Atryum denies the invocation.