List and retrieve evaluations and their run history.
https://catalyst-usw.agentuity.cloudAuthentication
All requests require a Bearer token. Pass your SDK key in the Authorization header.
| Header | Value |
|---|---|
Authorization | Bearer YOUR_SDK_KEY |
You can find your SDK key in the Agentuity Console under your project settings.
List Evaluations
List evaluations with optional filtering by organization, project, or agent.
GET
/cli/evalhttps://catalyst-usw.agentuity.cloud/cli/evalParameters
query
| Name | Type | Required | Description |
|---|---|---|---|
orgId | string | No | Filter by organization ID |
projectId | string | No | Filter by project ID |
agentId | string | No | Filter by agent ID |
Response
Array of evaluation objects.
| Status | Description |
|---|---|
| 200 | Evaluations returned |
| 401 | Unauthorized — invalid or missing Bearer token |
Response Fields
| Field | Type | Description |
|---|---|---|
id | string | Evaluation ID |
name | string | Evaluation name |
description | string | null | Evaluation description |
identifier | string | null | Stable evaluation identifier |
agentIdentifier | string | Agent identifier |
projectId | string | Project ID |
devmode | boolean | Whether this is a devmode evaluation |
createdAt | string | Creation timestamp |
updatedAt | string | Last updated timestamp |
Example
curl -X GET 'https://catalyst-usw.agentuity.cloud/cli/eval' \
-H 'Authorization: Bearer $AGENTUITY_SDK_KEY'Get Evaluation
Get a specific evaluation by ID.
GET
/cli/eval/{id}https://catalyst-usw.agentuity.cloud/cli/eval/{id}Parameters
path
| Name | Type | Required | Description |
|---|---|---|---|
id | string | Yes | Evaluation ID |
Response
Evaluation object.
| Status | Description |
|---|---|
| 200 | Evaluation returned |
| 401 | Unauthorized — invalid or missing Bearer token |
| 404 | Evaluation not found |
Example
curl -X GET 'https://catalyst-usw.agentuity.cloud/cli/eval/eval_abc123' \
-H 'Authorization: Bearer $AGENTUITY_SDK_KEY'Eval Runs
List Eval Runs
List evaluation runs with optional filtering.
GET
/cli/eval-runhttps://catalyst-usw.agentuity.cloud/cli/eval-runParameters
query
| Name | Type | Required | Description |
|---|---|---|---|
orgId | string | No | Filter by organization ID |
projectId | string | No | Filter by project ID |
agentId | string | No | Filter by agent ID |
evalId | string | No | Filter by evaluation ID |
sessionId | string | No | Filter by session ID |
Response
Array of evaluation run objects.
| Status | Description |
|---|---|
| 200 | Eval runs returned |
| 401 | Unauthorized — invalid or missing Bearer token |
Response Fields
| Field | Type | Description |
|---|---|---|
id | string | Eval run ID |
sessionId | string | Session ID |
evalId | string | Evaluation record ID |
evalIdentifier | string | null | Stable evaluation identifier |
evalName | string | null | Evaluation name |
agentIdentifier | string | null | Agent identifier |
projectId | string | Project ID |
deploymentId | string | null | Deployment ID |
devmode | boolean | Whether this is a devmode run |
pending | boolean | Whether the eval run is pending |
success | boolean | Whether the eval run succeeded |
error | string | null | Error message if failed |
result | any | null | Eval run result |
createdAt | string | Creation timestamp |
updatedAt | string | Last updated timestamp |
Example
curl -X GET 'https://catalyst-usw.agentuity.cloud/cli/eval-run' \
-H 'Authorization: Bearer $AGENTUITY_SDK_KEY'Get Eval Run
Get a specific evaluation run by ID.
GET
/cli/eval-run/{id}https://catalyst-usw.agentuity.cloud/cli/eval-run/{id}Parameters
path
| Name | Type | Required | Description |
|---|---|---|---|
id | string | Yes | Eval run ID |
Response
Evaluation run object.
| Status | Description |
|---|---|
| 200 | Eval run returned |
| 401 | Unauthorized — invalid or missing Bearer token |
| 404 | Eval run not found |
Example
curl -X GET 'https://catalyst-usw.agentuity.cloud/cli/eval-run/er_abc123' \
-H 'Authorization: Bearer $AGENTUITY_SDK_KEY'