Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Body
Name of the scenario.
The input context for the Scenario.
The scoring contract for the Scenario.
The Environment in which the Scenario will run.
User defined metadata to attach to the scenario for organization.
A string representation of the reference output to solve the scenario. Commonly can be the result of a git diff or a sequence of command actions to apply to the environment.
Environment variables required to run the scenario. If these variables are not provided, the scenario will fail to start.
Secrets required to run the scenario (user secret name to scenario required secret name). If these secrets are not provided or the mapping is incorrect, the scenario will fail to start.
Validation strategy.
UNSPECIFIED
, FORWARD
, REVERSE
, EVALUATION
Response
OK
A ScenarioDefinitionView represents a repeatable AI coding evaluation test, complete with initial environment and scoring contract.
The ID of the Scenario.
The name of the Scenario.
The input context for the Scenario.
The scoring contract for the Scenario.
User defined metadata to attach to the scenario for organization.
The Environment in which the Scenario is run.
A string representation of the reference output to solve the scenario. Commonly can be the result of a git diff or a sequence of command actions to apply to the environment.
Environment variables required to run the scenario. If any required environment variables are missing, the scenario will fail to start.
Environment variables required to run the scenario. If any required secrets are missing, the scenario will fail to start.
Whether this scenario is public.
Validation strategy.
UNSPECIFIED
, FORWARD
, REVERSE
, EVALUATION