Skip to main content
Access these methods through client.benchmark_definitions.

client.benchmark_definitions.create

Create a benchmark named with up to 64 lowercase letters and digits joined by single ., _, or -. An archived benchmark keeps its name, so restore it instead of creating it again.
Signature
Parameters
required · str
optional · str · default:
Returns BenchmarkDefinitionResponse For examples, see the Python SDK guide.

client.benchmark_definitions.list

List your organization’s benchmarks, adding archived ones when include_archived is true.
Signature
Parameters
optional · bool · default:
Returns BenchmarkDefinitionsResponse For examples, see the Python SDK guide.

client.benchmark_definitions.get

Fetch one benchmark by name.
Signature
Parameters
required · str
Returns BenchmarkDefinitionResponse For examples, see the Python SDK guide.

client.benchmark_definitions.update

Replace a benchmark’s description.
Signature
Parameters
required · str
required · str
Returns BenchmarkDefinitionResponse For examples, see the Python SDK guide.

client.benchmark_definitions.remove

Archive a benchmark once all its datasets are archived; restore brings it back.
Signature
Parameters
required · str
Returns BenchmarkDefinitionResponse For examples, see the Python SDK guide.

client.benchmark_definitions.restore

Restore an archived benchmark.
Signature
Parameters
required · str
Returns BenchmarkDefinitionResponse For examples, see the Python SDK guide.