Managing Blueprints
Keep your agent descriptions up to date as your agents evolve.
Blueprints are the foundation of Invarium’s test generation. They describe what your agent does — its tools, workflows, constraints, and expected behaviors. The dashboard provides a central place to view and manage all blueprints in your workspace.
Viewing blueprints
Navigate to Agents in the sidebar. Each agent card shows:
- Agent name — The identifier used for test generation and results
- Framework — The framework used (LangChain, CrewAI, AutoGen, custom)
- Tools count — Number of tools defined in the blueprint
- Last updated — When the blueprint was last modified
- Current BSS — The most recent BSS score
Click an agent card to open its detail page.
Agent detail page
The agent detail page has several tabs:
Blueprint tab
Displays the full blueprint JSON with syntax highlighting. You can:
- Copy — Copy the entire blueprint to clipboard
- Edit — Open the inline editor (see below)
- Download — Save the blueprint as a JSON file
Test runs tab
Lists all test runs for this agent with direct links to results. Same functionality as the Test Runs page but filtered to this agent.
BSS tab
Shows the BSS score trend and breakdown for this agent specifically.
Graph tab
Shows the Agent Intelligence Graph for this agent.
Editing a blueprint
To edit a blueprint in the dashboard:
- Open the agent detail page
- Go to the Blueprint tab
- Click Edit
- The JSON editor opens with the current blueprint loaded
- Make your changes
- Click Save
The editor provides:
- Syntax highlighting — JSON color coding for readability
- Validation — Real-time validation against the blueprint schema. Errors are highlighted inline.
Editing a blueprint does not automatically re-generate test cases. After saving changes, generate new tests to ensure your test suite reflects the updated blueprint.
Version history
Coming Soon — Blueprint version history is under development. You will be able to view previous versions, compare changes, and restore earlier blueprints. Currently, uploading a new blueprint replaces the previous one.
Deleting an agent
To delete an agent and its blueprint:
- Open the agent detail page
- Click the Settings gear icon
- Click Delete Agent
- Confirm the deletion
Deleting an agent removes the blueprint, all test runs, all test results, and all traces associated with that agent. This action cannot be undone. Export any data you need before deleting.
Blueprint best practices
- Keep blueprints current. When you add tools or change constraints in your agent, update the blueprint. Outdated blueprints generate tests that do not match your agent’s actual behavior.
- Use descriptive tool descriptions. The Scenario Generator uses tool descriptions to craft realistic test scenarios. Vague descriptions produce less targeted tests.
- Include constraints. Constraints define what your agent should not do. Without them, guardrail violation tests cannot be generated effectively.
- Review version history after team changes. When multiple team members update blueprints, check the history to understand what changed and why.
For a detailed guide on writing effective blueprints, see Upload a Blueprint.