Skip to content

Project AIRT summary

GET
/api/v1/org/{org}/ws/{workspace}/airt/projects/{project}/summary

Get aggregated AIRT metrics for a project

org
required
Org

Organization slug

string

Organization slug

workspace
required
Workspace

Workspace slug

string

Workspace slug

project
required
Project

Project slug or UUID

string

Project slug or UUID

Successful Response

ProjectAirtSummaryResponse
object
assessments
required
Assessments
Array<object>
AssessmentDetail

Full assessment with nested attack runs and report metadata.

object
asr_by_attack
Any of:
object
key
additional properties
any
asr_by_category
Any of:
object
key
additional properties
any
asr_by_transform
Any of:
object
key
additional properties
any
attack_runs
required
Attack Runs
Array<object>
AttackRunSummary

Compact attack run for operator drill-down.

object
asr
Any of:
number
assessment_id
required
Assessment Id
string format: uuid
attack_name
required
Attack Name
string
attacker_model
Any of:
string
best_candidate
Any of:
string
best_response
Any of:
string
best_score
required
Any of:
number
completed_at
required
Any of:
string format: date-time
compliance_tags
Any of:
object
key
additional properties
any
created_at
required
Created At
string format: date-time
execution_time_s
required
Any of:
number
finished_trials
Any of:
integer
goal
required
Goal
string
goal_category
required
Any of:
string
id
required
Id
string format: uuid
risk_domain
Any of:
string
status
required
Status
string
Allowed values: pending running completed failed
target_model
Any of:
string
total_trials
Any of:
integer
transforms_applied
required
Any of:
Array<string>
attacker_config
required
Any of:
object
key
additional properties
any
attacker_model
Any of:
string
completed_at
required
Any of:
string format: date-time
compliance_matrix
Any of:
object
key
additional properties
any
coverage_summary
Any of:
object
key
additional properties
any
created_at
required
Created At
string format: date-time
description
required
Any of:
string
duration_s
Any of:
number
execution_stats
Any of:
object
key
additional properties
any
finding_type_counts
Any of:
object
key
additional properties
integer
id
required
Id
string format: uuid
judge_model
Any of:
string
name
required
Name
string
overall_asr
required
Any of:
number
recommendations
Any of:
Array<object>
object
key
additional properties
any
reports
required
Reports
Array<object>
ReportSummary

Report metadata (content excluded for summary).

object
assessment_id
required
Assessment Id
string format: uuid
created_at
required
Created At
string format: date-time
id
required
Id
string format: uuid
report_type
required
Report Type
string
Allowed values: markdown json executive_summary
risk_level
Any of:
string
risk_score
required
Any of:
number
runtime_id
Any of:
string format: uuid
sandbox_detail
Any of:
SandboxSummary

Lightweight sandbox info embedded in assessment responses.

object
provider
required
Provider
string
provider_sandbox_id
required
Provider Sandbox Id
string
state
required
State
string
total_runtime_seconds
Any of:
number
sandbox_id
Any of:
string format: uuid
session_id
required
Any of:
string format: uuid
severity_breakdown
Any of:
object
key
additional properties
integer
started_at
Any of:
string format: date-time
status
required
Status
string
Allowed values: pending running completed failed
target_config
required
Any of:
object
key
additional properties
any
target_model
Any of:
string
top_findings
Any of:
Array<object>
object
key
additional properties
any
total_attacks
required
Total Attacks
integer
total_trials
required
Total Trials
integer
transform_lift
Any of:
object
key
additional properties
number
updated_at
required
Updated At
string format: date-time
assessments_by_status
required
Assessments By Status
object
key
additional properties
integer
attack_effectiveness
required
Attack Effectiveness
Array<object>
AttackEffectiveness

How effective each attack type is across the project.

object
assessments_used_in
required
Assessments Used In
Array<string>
attack_name
required
Attack Name
string
avg_asr
Any of:
number
avg_best_score
required
Avg Best Score
number
avg_execution_time_s
Any of:
number
goal_categories_targeted
Goal Categories Targeted
Array<string>
default:
max_best_score
Any of:
number
min_best_score
Any of:
number
success_rate
Any of:
number
times_used
required
Times Used
integer
total_finished_trials
Total Finished Trials
integer
0
total_trials
required
Total Trials
integer
avg_asr
required
Any of:
number
avg_risk_score
required
Any of:
number
compliance_posture
required
Compliance Posture
Array<object>
CompliancePosture

Aggregated compliance coverage across all assessments.

object
coverage_pct
required
Coverage Pct
number
failing_categories
required
Failing Categories
Array<string>
framework
required
Framework
string
max_asr_by_category
required
Max Asr By Category
object
key
additional properties
number
max_severity_by_category
required
Max Severity By Category
object
key
additional properties
string
passing_categories
required
Passing Categories
Array<string>
tested_categories
required
Tested Categories
integer
total_categories
required
Total Categories
integer
untested_categories
required
Untested Categories
Array<string>
executive_summary
required
ExecutiveSummary

High-level metrics for executive and board-level dashboards.

object
all_attacker_models
All Attacker Models
Array<string>
default:
all_judge_models
All Judge Models
Array<string>
default:
all_target_models
All Target Models
Array<string>
default:
avg_compliance_coverage_pct
required
Any of:
number
best_attacker_model
Any of:
string
best_attacker_model_asr
Any of:
number
best_judge_model
Any of:
string
best_judge_model_findings
Any of:
integer
compliance_frameworks_tested
required
Compliance Frameworks Tested
Array<string>
critical_findings
required
Critical Findings
integer
finding_type_distribution
Finding Type Distribution
object
key
additional properties
integer
first_assessment_date
required
Any of:
string format: date-time
high_findings
required
High Findings
integer
last_assessment_date
required
Any of:
string format: date-time
low_findings
required
Low Findings
integer
medium_findings
required
Medium Findings
integer
most_effective_attack
Any of:
string
most_effective_attack_asr
Any of:
number
overall_asr
required
Any of:
number
overall_risk_level
required
Overall Risk Level
string
overall_risk_score
required
Any of:
number
risk_by_domain
required
Risk By Domain
Array<object>
RiskDomainSummary

ASR and finding counts grouped by risk domain (exec-friendly).

object
assessments_affected
required
Assessments Affected
Array<string>
avg_asr
Any of:
number
categories
required
Categories
Array<string>
critical_findings
required
Critical Findings
integer
domain
required
Domain
string
high_findings
required
High Findings
integer
max_score
Any of:
number
medium_findings
required
Medium Findings
integer
total_findings
required
Total Findings
integer
severity_distribution
required
Severity Distribution
object
key
additional properties
integer
total_assessments
required
Total Assessments
integer
total_attacks
required
Total Attacks
integer
total_execution_time_s
Any of:
number
total_findings
required
Total Findings
integer
total_reports
required
Total Reports
integer
total_trials
required
Total Trials
integer
total_unique_transforms
Total Unique Transforms
integer
0
worst_category
required
Any of:
string
worst_category_asr
required
Any of:
number
worst_compliance_coverage_pct
Any of:
number
worst_compliance_framework
Any of:
string
goals
required
Goals
Array<object>
GoalDetail

Per-goal breakdown — how well was each specific goal achieved.

object
asr
Any of:
number
assessments
required
Assessments
Array<string>
attack_names_used
required
Attack Names Used
Array<string>
avg_score
Any of:
number
best_score
required
Best Score
number
goal
required
Goal
string
goal_category
required
Goal Category
string
risk_domain
Any of:
string
total_trials
required
Total Trials
integer
transforms_used
Transforms Used
Array<string>
default:
last_activity_at
Any of:
string format: date-time
project_created_at
Any of:
string format: date-time
project_id
Any of:
string format: uuid
project_key
Any of:
string
project_name
Any of:
string
project_updated_at
Any of:
string format: date-time
risk_trend
required
Risk Trend
Array<object>
RiskTrendPoint

Single data point for risk timeline charts.

object
assessment_id
required
Assessment Id
string
assessment_name
required
Assessment Name
string
critical_findings
Critical Findings
integer
0
date
required
Date
string format: date-time
overall_asr
required
Any of:
number
risk_level
required
Risk Level
string
risk_score
required
Risk Score
number
severity_breakdown
Severity Breakdown
object
key
additional properties
integer
status
required
Status
string
total_attacks
required
Total Attacks
integer
total_findings
Total Findings
integer
0
top_findings
required
Top Findings
Array<object>
FindingSummary

Top finding across the project (aggregated from all assessments).

object
assessment_id
required
Assessment Id
string
assessment_name
required
Assessment Name
string
attack_name
required
Attack Name
string
attack_run_id
Any of:
string
attacker_model
Any of:
string
candidate
required
Candidate
string
compliance_tags
Compliance Tags
object
key
additional properties
any
evaluator_model
Any of:
string
execution_time_ms
Execution Time Ms
number
0
finding_type
Finding Type
string
default: jailbreak
goal
required
Goal
string
goal_category
required
Goal Category
string
rank
required
Rank
integer
response
required
Response
string
risk_domain
Any of:
string
score
required
Score
number
secondary_scores
Secondary Scores
object
key
additional properties
number
severity
required
Severity
string
target_model
Any of:
string
transforms_applied
Transforms Applied
Array<string>
default:
trial_index
Any of:
integer
trial_number
Trial Number
integer
0
top_vulnerabilities
required
Top Vulnerabilities
Array<object>
VulnerabilityEntry

Vulnerability with frequency and severity data.

object
assessments_affected
required
Assessments Affected
Array<string>
attack_names_used
Attack Names Used
Array<string>
default:
avg_asr
Any of:
number
category
required
Category
string
count
required
Count
integer
max_score
Any of:
number
max_severity
Any of:
string
risk_domain
Any of:
string
transforms_used
Transforms Used
Array<string>
default:
total_assessments
required
Total Assessments
integer
total_attacks
required
Total Attacks
integer
total_trials
required
Total Trials
integer
transform_effectiveness
required
Transform Effectiveness
Array<object>
TransformEffectiveness

How effective each transform is across the project.

object
assessments_used_in
required
Assessments Used In
Array<string>
attack_names_used_with
Attack Names Used With
Array<string>
default:
avg_asr
Any of:
number
avg_best_score
required
Avg Best Score
number
lift
Any of:
number
max_best_score
Any of:
number
times_used
required
Times Used
integer
transform
required
Transform
string

Invalid request

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Authentication failed

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Access forbidden

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Not found

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Already exists

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Validation error

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Upgrade required

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Rate limited

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Internal server error

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Bad gateway

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error

Gateway timeout

APIErrorPayload

Canonical API error envelope returned by the API.

object
code
required
Code

HTTP status code

integer
Allowed values: 400 401 403 404 409 422 426 429 500 502 504
detail
required
Detail

Human-readable error message

string
errors
Any of:
Array<object>
ValidationErrorItem
object
loc
required
Loc

Where the validation error occurred

Array
msg
required
Msg

Human-readable validation message

string
type
required
Type

Machine-readable validation error type

string
type
required
Type

Stable machine-readable error type

string
Allowed values: already_exists_error app_error authentication_error conflict_error aws_error configuration_error database_error dynamodb_error e2b_error e2b_rate_limit_error expired_signature_error expired_token_error forbidden_error group_error invalid_error invalid_flag_error invalid_username_error mail_error member_exists_error member_limit_exceeded_error migration_lock_timeout_error not_found_error oauth_config_error org_sandbox_capacity_exceeded_error bad_gateway_error gateway_timeout_error s3_error server_error task_error stripe_error token_error upgrade_required_error usage_limit_exceeded_error user_verification_error validation_error