> ## Documentation Index
> Fetch the complete documentation index at: https://docs.valkyrie.vals.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Custom benchmark services

> Connect Valkyrie to a benchmark service endpoint.

A benchmark service supplies tasks and evaluates run outputs. A custom service overrides a built-in service with the same name.

Full syntax is in the [`config service set`](/reference/cli/config#service-set), [`config service list`](/reference/cli/config#service-list), and [`config service remove`](/reference/cli/config#service-remove) reference.

## Register an endpoint

```bash theme={null}
valkyrie config service set swebench https://my-tunnel.ngrok.io
```

The tracker must be able to reach the endpoint. Local services generally require a reverse tunnel; see the [benchmark-service reverse-tunnel guide](https://github.com/vals-ai/create-benchmark-service?tab=readme-ov-file#reverse-tunnel-setup).

## List custom services

```bash theme={null}
valkyrie config service list
```

The interactive list supports `[h]` for previous, `[l]` for next, and `[q]` to quit.

## Remove a service

```bash theme={null}
valkyrie config service remove swebench
```

## Build a service

Use the public [create-benchmark-service](https://github.com/vals-ai/create-benchmark-service) utilities to implement a compatible service.
