// Command reference

simforge open-loop

Generated from the CLI's own help (CLI 0.2.0-rc.5). Global flags and exit codes are on the reference index.

simforge open-loop artifacts

A download grant ({url, sha256, bytes, ...}) for one artifact of the evaluation's result

simforge open-loop artifacts [OPTIONS] <EVALUATION_ID> <ARTIFACT_ID>

Argument / flag	Notes	What
<evaluation_id>	required	The evaluation (`cmpj_...`)
<artifact_id>	required	The artifact, by its id in the result manifest

List the workspace's evaluations

simforge open-loop list [OPTIONS]

Argument / flag	Notes	What
--limit LIMIT		At most this many evaluations (1-100)
--status STATUS		Only evaluations in these statuses (comma-separated)
--cursor CURSOR		The page after this cursor (`nextCursor` of the previous page)

The evaluation's result manifest: scored metrics, artifacts, model/render/source pins and compute cost

simforge open-loop result [OPTIONS] <EVALUATION_ID>

Argument / flag	Notes	What
<evaluation_id>	required	The evaluation (`cmpj_...`)

Score a succeeded cloud scenario render with the pinned Alpamayo 1.5 model (requires --cloud, --max-cost and --idempotency-key, also with --dry-run)

simforge open-loop run [OPTIONS] --max-cost <CENTS> <RENDER_RUN_ID>

Argument / flag	Notes	What
<render_run_id>	required	The succeeded cloud scenario render run to evaluate
--prediction-interval-s SECONDS	default 0.5	Seconds between scored prediction instants across the whole render; an exact multiple of 0.1 (0.5 = 2 Hz)
--seed SEED	default 1	Model sampling seed
--samples N	default 1	Trajectory samples drawn by the model
--max-cost CENTS	required	Explicit maximum cloud cost in cents; required, also with --dry-run
--wait		Wait for the evaluation to finish

One evaluation: status, cost and attempts

simforge open-loop show [OPTIONS] <EVALUATION_ID>

Argument / flag	Notes	What
<evaluation_id>	required	The evaluation (`cmpj_...`)

Follow an evaluation until it succeeds, is partial, fails or is cancelled

simforge open-loop watch [OPTIONS] <EVALUATION_ID>

Argument / flag	Notes	What
<evaluation_id>	required	The evaluation (`cmpj_...`)