Get trial spans

GET

/api/v1/org/{org}/ws/{workspace}/airt/assessments/{assessment_id}/traces/trials

curl --request GET \
  --url 'https://example.com/api/v1/org/example/ws/example/airt/assessments/2489E9AD-2EE2-8E00-8EC9-32D5F69181C0/traces/trials?jailbreaks_only=false&limit=500' \
  --header 'Authorization: Bearer <token>'

Get individual trial results from OTEL traces

Authorizations

• OAuth2PasswordBearer
• APIKeyCookie
• APIKeyHeader

Parameters

Path Parameters

assessment_id

required

Assessment Id

string format: uuid

org

required

Org

Organization slug

string

Organization slug

workspace

required

Workspace

Workspace slug

string

Workspace slug

Query Parameters

attack_name

Any of:

string

string

null

null

Filter by attack name

min_score

Any of:

number

number

null

null

Minimum score filter

jailbreaks_only

Jailbreaks Only

Only return jailbreak trials

boolean

Only return jailbreak trials

limit

Limit

Max results

integer

default: 500 >= 1 <= 5000

Max results

Responses

200

Successful Response

Media type application/json

Response Get Airt Trial Spans Org Org Ws Workspace Airt Assessments Assessment Id Traces Trials Get

Array<object>

TrialSpanResponse

Individual trial result from OTEL spans.

object

attack_name

Attack Name

string

""

candidate

Candidate

string

""

execution_time_s

Execution Time S

number

0

goal

Goal

string

""

goal_category

Goal Category

string

""

is_jailbreak

Is Jailbreak

boolean

judge_reasoning

Judge Reasoning

string

""

response

Response

string

""

score

Score

number

0

span_id

Span Id

string

""

target_model

Target Model

string

""

timestamp

Timestamp

string

""

trace_id

Trace Id

string

""

transformed_prompt

Transformed Prompt

string

""

transforms

Transforms

Array<string>

default:

trial_index

Trial Index

integer

0

trial_status

Trial Status

string

""

Example

[
  {
    "attack_name": "",
    "candidate": "",
    "execution_time_s": 0,
    "goal": "",
    "goal_category": "",
    "is_jailbreak": false,
    "judge_reasoning": "",
    "response": "",
    "score": 0,
    "span_id": "",
    "target_model": "",
    "timestamp": "",
    "trace_id": "",
    "transformed_prompt": "",
    "transforms": [],
    "trial_index": 0,
    "trial_status": ""
  }
]

400

Invalid request

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}

401

Authentication failed

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}

403

Access forbidden

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}

404

Not found

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}

409

Already exists

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}

422

Validation error

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}

426

Upgrade required

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}

429

Rate limited

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}

500

Internal server error

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}

502

Bad gateway

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}

504

Gateway timeout

Media type application/json

APIErrorPayload

Canonical API error envelope returned by the API.

object

code

required

Code

HTTP status code

integer

Allowed values: 400 401 403 404 409 422 426 429 500 502 504

detail

required

Detail

Human-readable error message

string

errors

Any of:

Array<object>

Array<object>

ValidationErrorItem

object

loc

required

Loc

Where the validation error occurred

Array

msg

required

Msg

Human-readable validation message

string

type

required

Type

Machine-readable validation error type

string

null

null

type

required

Type

Stable machine-readable error type

string

Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Example

{
  "code": 401,
  "detail": "Authentication failed",
  "type": "authentication_error"
}