Settings resource

Access these methods through client.settings.

`client.settings.get`

Show your default sandbox provider and saved benchmark services.

Signature

async def get() -> RunSettingsResponse

Returns RunSettingsResponse For examples, see the Python SDK guide.

`client.settings.set_default_provider`

Run on this sandbox provider unless a run names another. Needs a login, not an access key.

Signature

async def set_default_provider(provider: str) -> RunSettingsResponse

Parameters

required · str

Returns RunSettingsResponse For examples, see the Python SDK guide.

`client.settings.set_benchmark_service`

Use this URL for your runs of a benchmark, replacing the URL and credential saved before. Tracker sends the auth_secret secret’s value in auth_header, Authorization by default. Needs a login, not an access key.

Signature

async def set_benchmark_service(
    benchmark: str,
    url: str,
    *,
    auth_secret: str | None = None,
    auth_header: str | None = None,
) -> RunSettingsResponse

Parameters

required · str

optional · str | None · default:

Returns RunSettingsResponse For examples, see the Python SDK guide.

`client.settings.remove_benchmark_service`

Go back to the hosted service for your runs of a benchmark.

Signature

async def remove_benchmark_service(benchmark: str) -> RunSettingsResponse

Parameters

required · str

Returns RunSettingsResponse For examples, see the Python SDK guide.

Get started

Agents

Runs

Benchmarks

Integrations

Python SDK

CLI reference

Python SDK reference

Self-hosting

Settings resource

`client.settings.get`

`client.settings.set_default_provider`

`client.settings.set_benchmark_service`

`client.settings.remove_benchmark_service`

​client.settings.get

​client.settings.set_default_provider

​client.settings.set_benchmark_service

​client.settings.remove_benchmark_service

`client.settings.get`

`client.settings.set_default_provider`

`client.settings.set_benchmark_service`

`client.settings.remove_benchmark_service`