Update a Scenario. Fields that are null will preserve the existing value. Fields that are provided (including empty values) will replace the existing value entirely.
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
The Scenario ID.
ScenarioUpdateParameters contain the set of parameters to update a Scenario. All fields are optional - null fields preserve existing values, provided fields replace entirely.
Name of the scenario. Cannot be blank.
The input context for the Scenario.
The scoring contract for the Scenario.
The Environment in which the Scenario will run.
User defined metadata to attach to the scenario. Pass in empty map to clear.
Environment variables required to run the scenario. Pass in empty list to clear.
Secrets required to run the scenario. Pass in empty list to clear.
A string representation of the reference output to solve the scenario. Commonly can be the result of a git diff or a sequence of command actions to apply to the environment. Pass in empty string to clear.
Validation strategy. Pass in empty string to clear.
UNSPECIFIED, FORWARD, REVERSE, EVALUATION OK
A ScenarioDefinitionView represents a repeatable AI coding evaluation test, complete with initial environment and scoring contract.
The ID of the Scenario.
The name of the Scenario.
The input context for the Scenario.
The scoring contract for the Scenario.
User defined metadata to attach to the scenario for organization.
The Environment in which the Scenario is run.
A string representation of the reference output to solve the scenario. Commonly can be the result of a git diff or a sequence of command actions to apply to the environment.
Environment variables required to run the scenario. If any required environment variables are missing, the scenario will fail to start.
Environment variables required to run the scenario. If any required secrets are missing, the scenario will fail to start.
Whether this scenario is public.
Validation strategy.
UNSPECIFIED, FORWARD, REVERSE, EVALUATION