> ## Documentation Index
> Fetch the complete documentation index at: https://docs.valkyrie.vals.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# valkyrie benchmark

> Complete generated reference for every `valkyrie benchmark` command.

This page documents all 1 commands in the `benchmark` group in registration order. Use the table of contents to jump to a command.

<h2 id="tasks">
  `valkyrie benchmark tasks`
</h2>

Save task IDs for a benchmark dataset.

```bash Syntax theme={null}
valkyrie benchmark tasks \
  <BENCHMARK_NAME> \
  [--dataset <TEXT>] \
  [--header|-H <TEXT> <TEXT>...] \
  [--ignore-custom-services|--ics] \
  [--output|-o <PATH>]
```

```bash Example theme={null}
valkyrie benchmark tasks \
  swebench \
  --dataset default
```

**Arguments**

<div className="border-b border-gray-200 py-3 dark:border-gray-800">
  <div className="flex min-w-0 flex-wrap items-baseline gap-x-2 gap-y-1"><span className="break-all font-mono text-sm">{"BENCHMARK_NAME"}</span><span className="min-w-0 break-words text-sm text-gray-500 dark:text-gray-400">required · <code>{"text"}</code></span></div>
</div>

**Options**

<div className="border-b border-gray-200 py-3 dark:border-gray-800">
  <div className="flex min-w-0 flex-wrap items-baseline gap-x-2 gap-y-1"><span className="break-all font-mono text-sm">{"--dataset"}</span><span className="min-w-0 break-words text-sm text-gray-500 dark:text-gray-400">optional · <code>{"text"}</code> · default: <code>{"None"}</code></span></div>

  <p className="mb-0 mt-1">
    {"Dataset name to fetch from the benchmark service (defaults to 'default')"}
  </p>
</div>

<div className="border-b border-gray-200 py-3 dark:border-gray-800">
  <div className="flex min-w-0 flex-wrap items-baseline gap-x-2 gap-y-1"><span className="break-all font-mono text-sm">{"--header, -H"}</span><span className="min-w-0 break-words text-sm text-gray-500 dark:text-gray-400">optional · <code>{"tuple[text, text]"}</code> · constraints: {"2 values; repeatable"}</span></div>

  <p className="mb-0 mt-1">
    {"Custom header for benchmark service requests (e.g., -H Authorization my-credential)"}
  </p>
</div>

<div className="border-b border-gray-200 py-3 dark:border-gray-800">
  <div className="flex min-w-0 flex-wrap items-baseline gap-x-2 gap-y-1"><span className="break-all font-mono text-sm">{"--ignore-custom-services, --ics"}</span><span className="min-w-0 break-words text-sm text-gray-500 dark:text-gray-400">optional · <code>{"boolean"}</code> · default: <code>{"False"}</code></span></div>

  <p className="mb-0 mt-1">
    {"Ignore custom benchmark services that have been configured. Provides opt-out for custom services."}
  </p>
</div>

<div className="border-b border-gray-200 py-3 dark:border-gray-800">
  <div className="flex min-w-0 flex-wrap items-baseline gap-x-2 gap-y-1"><span className="break-all font-mono text-sm">{"--output, -o"}</span><span className="min-w-0 break-words text-sm text-gray-500 dark:text-gray-400">optional · <code>{"path"}</code> · default: <code>{"None"}</code> · constraints: {"file; readable"}</span></div>

  <p className="mb-0 mt-1">
    {"Path to save task IDs, one per line. Defaults to <benchmark>-<dataset>-tasks.txt."}
  </p>
</div>

Task guidance: [Benchmark guides](/benchmarks/custom-services).