> ## Documentation Index
> Fetch the complete documentation index at: https://docs.valkyrie.vals.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Benchmark services resource

> Async operations for hosted and custom benchmark services.

Access these methods through `client.services`.

<h2 id="catalog">
  `client.services.catalog`
</h2>

List hosted benchmark services visible to the configured tenant.

```python Signature theme={null}
async def catalog() -> BenchmarkServiceCatalogResponse
```

**Returns**

<a href="/reference/sdk/models/services#benchmark-service-catalog-response"><code>BenchmarkServiceCatalogResponse</code></a>

For examples, see the [Python SDK guide](/sdk/resources).

<h2 id="list">
  `client.services.list`
</h2>

List hosted services and return their current health.

```python Signature theme={null}
async def list() -> BenchmarkServicesResponse
```

**Returns**

<a href="/reference/sdk/models/services#benchmark-services-response"><code>BenchmarkServicesResponse</code></a>

For examples, see the [Python SDK guide](/sdk/resources).

<h2 id="task-ids">
  `client.services.task_ids`
</h2>

Fetch task IDs for a benchmark dataset.

```python Signature theme={null}
async def task_ids(
    benchmark: str,
    *,
    dataset: str | None = None,
    service_headers: Mapping[str, str] | None = None,
    ignore_custom_services: bool = False,
) -> list[str]
```

**Parameters**

<div className="border-b border-gray-200 py-3 dark:border-gray-800">
  <div className="flex min-w-0 flex-wrap items-baseline gap-x-2 gap-y-1"><span className="break-all font-mono text-sm">{"benchmark"}</span><span className="min-w-0 break-words text-sm text-gray-500 dark:text-gray-400">required · str</span></div>
</div>

<div className="border-b border-gray-200 py-3 dark:border-gray-800">
  <div className="flex min-w-0 flex-wrap items-baseline gap-x-2 gap-y-1"><span className="break-all font-mono text-sm">{"dataset"}</span><span className="min-w-0 break-words text-sm text-gray-500 dark:text-gray-400">optional · str | None · default: <code>{"None"}</code></span></div>
</div>

<div className="border-b border-gray-200 py-3 dark:border-gray-800">
  <div className="flex min-w-0 flex-wrap items-baseline gap-x-2 gap-y-1"><span className="break-all font-mono text-sm">{"service_headers"}</span><span className="min-w-0 break-words text-sm text-gray-500 dark:text-gray-400">optional · Mapping\[str, str] | None · default: <code>{"None"}</code></span></div>
</div>

<div className="border-b border-gray-200 py-3 dark:border-gray-800">
  <div className="flex min-w-0 flex-wrap items-baseline gap-x-2 gap-y-1"><span className="break-all font-mono text-sm">{"ignore_custom_services"}</span><span className="min-w-0 break-words text-sm text-gray-500 dark:text-gray-400">optional · bool · default: <code>{"False"}</code></span></div>
</div>

**Returns**

list\[str]

For examples, see the [Python SDK guide](/sdk/resources).