Inspect integration
Use sandbox="promigence" in Inspect and every sample gets its own cloud sandbox, with no Docker daemon on your machine. Tasks written for Docker, from a Dockerfile or a single-service compose file, run unchanged.
The package is inspect-promigence on PyPI, for Python.
Install
Install it and set your key.
pip install inspect-promigence openai
export PROMIGENCE_API_KEY=...
export PROMIGENCE_SPEND_CAP=1
Example
From the guide Run Inspect evals in a Promigence sandbox, which goes on to the spend cap, cleaning up, and what the package does not support.
from inspect_ai import Task, task
from inspect_ai.agent import react
from inspect_ai.dataset import Sample
from inspect_ai.scorer import includes
from inspect_ai.tool import bash
from inspect_promigence import PromigenceSandboxConfig
SANDBOX = (
"promigence",
PromigenceSandboxConfig(
image="python:3.12-slim",
verify="python3 -c 'import sys; assert sys.version_info >= (3, 12)'",
sandbox_timeout_sec=600,
),
)
@task
def hello_bash_agent() -> Task:
return Task(
dataset=[Sample(input="Use bash to print the Python version, then answer with it.", target="3.12")],
solver=react(tools=[bash(timeout=60)]),
scorer=includes(),
sandbox=SANDBOX,
message_limit=12,
)