> ## Documentation Index
> Fetch the complete documentation index at: https://docs.valkyrie.vals.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Benchmark definitions resource

> Create and manage the benchmarks your organization owns in Valkyrie.

Access these methods through `client.benchmark_definitions`.

## `client.benchmark_definitions.create`

Create a benchmark named with up to 64 lowercase letters and digits joined by single `.`, `_`, or `-`.

An archived benchmark keeps its name, so restore it instead of creating it again.

```python Signature theme={null}
async def create(name: str, *, description: str = '') -> BenchmarkDefinitionResponse
```

**Parameters**

namerequired · str

descriptionoptional · str · default: `''`

**Returns**

BenchmarkDefinitionResponse

For examples, see the [Python SDK guide](https://docs.valkyrie.vals.ai/sdk/resources.md).

## `client.benchmark_definitions.list`

List your organization's benchmarks, adding archived ones when include\_archived is true.

```python Signature theme={null}
async def list(*, include_archived: bool = False) -> BenchmarkDefinitionsResponse
```

**Parameters**

include\_archivedoptional · bool · default: `False`

**Returns**

BenchmarkDefinitionsResponse

For examples, see the [Python SDK guide](https://docs.valkyrie.vals.ai/sdk/resources.md).

## `client.benchmark_definitions.get`

Fetch one benchmark by name.

```python Signature theme={null}
async def get(name: str) -> BenchmarkDefinitionResponse
```

**Parameters**

namerequired · str

**Returns**

BenchmarkDefinitionResponse

For examples, see the [Python SDK guide](https://docs.valkyrie.vals.ai/sdk/resources.md).

## `client.benchmark_definitions.update`

Replace a benchmark's description.

```python Signature theme={null}
async def update(name: str, *, description: str) -> BenchmarkDefinitionResponse
```

**Parameters**

namerequired · str

descriptionrequired · str

**Returns**

BenchmarkDefinitionResponse

For examples, see the [Python SDK guide](https://docs.valkyrie.vals.ai/sdk/resources.md).

## `client.benchmark_definitions.remove`

Archive a benchmark once all its datasets are archived; restore brings it back.

```python Signature theme={null}
async def remove(name: str) -> BenchmarkDefinitionResponse
```

**Parameters**

namerequired · str

**Returns**

BenchmarkDefinitionResponse

For examples, see the [Python SDK guide](https://docs.valkyrie.vals.ai/sdk/resources.md).

## `client.benchmark_definitions.restore`

Restore an archived benchmark.

```python Signature theme={null}
async def restore(name: str) -> BenchmarkDefinitionResponse
```

**Parameters**

namerequired · str

**Returns**

BenchmarkDefinitionResponse

For examples, see the [Python SDK guide](https://docs.valkyrie.vals.ai/sdk/resources.md).


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.