Submit a review agent's eval
Record one review agent's result on one push of a change: a value (0–100 for a score agent, 1/0 for a boolean one), a short rationale, and any findings.…
Record one review agent's result on one push of a change: a value (0–100 for a score agent, 1/0 for a boolean one), a short rationale, and any findings. Submitting again for the same push replaces the earlier result and the open findings it raised. prUrl selects the change; omitted, the trail's primary change.
They are linked to the trail as detected, and a key that does not exist yet becomes a finding.
The agentKey normally names a configured review agent; an unconfigured key is recorded too, as a non-blocking score.
Safe for the restricted ops key.
A review run fired on a push scores the diff for risk and submits { agentKey: "risk", value: 35, rationale: "...", findings: [...] }.
Authorization
bearerSdkKey Pass an admin SDK key as Authorization: Bearer sdk_admin_…. Mint via POST /api/admin/keys with type: "admin".
In: header
Path Parameters
The trail's handle (T-12) or its id.
^(?:T-[0-9]+|[0-9a-fA-F-]{32,36})$1 <= length <= 64Header Parameters
Project the request operates on. Optional — defaults to the project the SDK key belongs to; pass it only to scope a multi-project key (the generated client sets it once from its configuration, so per-call callers never thread it).
Request Body
application/json
TypeScript Definitions
Use the request body type in TypeScript.
Response Body
application/json
application/json
application/json
application/json
application/json
application/json
curl -X POST "https://shipeasy.ai/api/admin/trails/string/evals" \ -H "Content-Type: application/json" \ -d '{ "agentKey": "risk", "value": 35, "rationale": "Touches the token refresh path; covered by the existing auth tests", "findings": [ { "severity": "medium", "title": "Refresh failure is swallowed", "path": "src/auth/refresh.ts", "line": 42 } ], "resources": [ { "kind": "gate", "resourceKey": "checkout.v2", "role": "ships_behind" } ] }'{
"eval": {
"id": "string",
"agentKey": "string",
"headSha": "string",
"status": "pending",
"value": 0,
"rationale": "string",
"reviewer": "string",
"sessionUrl": "string",
"error": "string",
"createdAt": "string",
"completedAt": "string"
},
"findings": [
{
"id": "string",
"agentKey": "string",
"headSha": "string",
"severity": "high",
"title": "string",
"body": "string",
"path": "string",
"line": 0,
"suggestion": "string",
"status": "open",
"stale": true,
"statusReason": "string",
"statusBy": "string",
"promotedItem": {
"id": "string",
"number": 0,
"type": "bug",
"title": "string",
"status": "open"
},
"createdAt": "string",
"updatedAt": "string"
}
]
}{
"error": "Malformed request (bad JSON, missing project scope).",
"code": "BAD_REQUEST"
}{
"error": "Missing or invalid admin SDK key.",
"code": "UNAUTHORIZED"
}{
"error": "Key is valid but not allowed to act on this project.",
"code": "FORBIDDEN"
}{
"error": "The resource does not exist or is not visible to the caller.",
"code": "NOT_FOUND"
}{
"error": "The request body failed structural (schema) validation.",
"code": "VALIDATION"
}Run the review agents
Launch the project's review agents on a change's latest push now, instead of waiting for the next push. Each agent's eval reads pending until its run…
Resolve or dismiss a finding
Set a finding's status — resolved (it was fixed; say how in reason), dismissed (it is not a problem; say why), or back to open. A finding that is real but…