Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Path Parameters
The Scenario ID.
Body
Name of the scenario.
The input context for the Scenario.
The scoring contract for the Scenario.
The Environment in which the Scenario will run.
User defined metadata to attach to the scenario for organization.
Environment variables required to run the scenario.
Secrets required to run the scenario.
A string representation of the reference output to solve the scenario. Commonly can be the result of a git diff or a sequence of command actions to apply to the environment.
Validation strategy.
FORWARD
, REVERSE
, EVALUATION
Response
OK
A ScenarioDefinitionView represents a repeatable AI coding evaluation test, complete with initial environment and scoring contract.
The ID of the Scenario.
The name of the Scenario.
The input context for the Scenario.
The scoring contract for the Scenario.
User defined metadata to attach to the scenario for organization.
The Environment in which the Scenario is run.
A string representation of the reference output to solve the scenario. Commonly can be the result of a git diff or a sequence of command actions to apply to the environment.
Environment variables required to run the scenario. If any required environment variables are missing, the scenario will fail to start.
Environment variables required to run the scenario. If any required secrets are missing, the scenario will fail to start.
Whether this scenario is public.
Validation strategy.
FORWARD
, REVERSE
, EVALUATION