Runloop is the AI Agent Accelerator — secure code sandboxes (Devboxes), evaluation infrastructure (Benchmarks, Scenarios), and production-grade orchestration for AI coding agents at enterprise scale. The platform provides a single REST API and matched Python/TypeScript SDKs covering Devbox lifecycle, Blueprint image building, Snapshot branching, Agent registry, Axon event streams with Broker bridges, Storage Objects, Secrets, Network Policies, Agent Gateways, MCP Configs, and a turnkey eval framework (SWE-Bench Verified, SWE-smith, custom benchmarks). Runloop runs on a custom bare-metal hypervisor with microVM-level isolation and is SOC 2 Type II, HIPAA, and GDPR compliant, with VPC deployment available for regulated workloads. Founded 2023 by Jonathan Wall (Google File System lead, Google Wallet co-founder, Index CTO acquired by Stripe).
APIs.json: https://raw.githubusercontent.com/api-evangelist/runloop-ai/refs/heads/main/apis.yml
- Access: 3rd-Party
- AI
- AI Agents
- Coding Agents
- Sandboxes
- Devboxes
- Code Execution
- Evaluation
- Benchmarks
- SWE-Bench
- MCP
- Snapshots
- microVM
- Enterprise
- SOC 2
- Created: 2026-05-25
- Modified: 2026-05-25
Create, configure, and operate Devboxes — isolated Linux microVM-backed sandbox environments purpose-built for AI coding agents. The Devbox API covers the full lifecycle (create, suspend, resume, snapshot, shutdown), synchronous and asynchronous command execution, named shell sessions, file I/O, code-repo mounts, agent and storage object mounts, network tunnels with HTTPS URLs, SSH key issuance, and rich observability (executions, metrics, logs). Includes the PTY control-plane for interactive WebSocket shell sessions.
- Human URL: https://docs.runloop.ai/docs/devboxes/overview
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Sandboxes
- Devboxes
- Coding Agents
- Documentation
- Documentation
- Documentation
- Documentation
- Documentation
- Documentation
- Documentation
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
- JSON Schema — JSON Schema
- JSON Schema — JSON Schema
- JSON Schema — JSON Schema
- JSON Schema — JSON Schema
- JSON Structure
- JSON-LD — JSON-LD
- Example
- Example
- Example
Build, preview, list, and manage Blueprints — Dockerfile-based container image templates that Devboxes launch from. Blueprints capture pre-installed system packages, language runtimes, code mounts, ports, and agent tooling so a fresh Devbox starts in seconds. Supports private blueprints, public discovery, metadata-keyed search, and creation from RepositoryConnection inspection.
- Human URL: https://docs.runloop.ai/docs/devboxes/blueprints/overview
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Blueprints
- Container Images
- Devboxes
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
Define, configure, and run Benchmarks against your agents. Runloop ships SWE-Bench Verified and SWE-smith out of the box; the Benchmark API also supports custom benchmarks built from your own scenarios and scorers. Resources include benchmarks, benchmark runs (with start, cancel, complete lifecycle), benchmark jobs, scenario runs, and downloadable run logs.
- Human URL: https://docs.runloop.ai/docs/benchmarks/overview
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Benchmarks
- Evaluation
- SWE-Bench
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
- JSON Schema — JSON Schema
- Example
Author and run individual evaluation Scenarios — the atomic test unit for AI coding agents. Each Scenario captures input context, environment setup, an agent invocation, and one or more Scenario Scorers that produce pass/fail signals plus structured scores. Used standalone or composed into Benchmarks.
- Human URL: https://docs.runloop.ai/docs/benchmarks/scenarios
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Scenarios
- Evaluation
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
Register and version Agents — packaged agent definitions sourced from Git, npm, pip, or pre-packaged storage objects. Once registered, an Agent can be mounted to any Devbox at create time for fast, reproducible installs. Includes public agent listings and per-agent Devbox-count reporting.
- Human URL: https://docs.runloop.ai/docs/devboxes/agents/using-agents-api
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Agent Registry
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
Create and operate Axons — Runloop's distributed event streams for sequencing, recording, and observing agent interactions. Each Axon supports event publish, SSE subscription, SQL queries and batch operations over event history, and a Broker bridge that connects an Axon to agents running inside Devboxes using ACP or Claude agent client protocols.
- Human URL: https://docs.runloop.ai/docs/axons/overview
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Event Streams
- Axon
- Broker
- ACP
- Documentation
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
- Example
Upload and manage Storage Objects — managed files with presigned download URLs that can be mounted into Devboxes or shared between agent runs. Two-step upload (create -> complete), public listings, metadata-keyed search, and download presign.
- Human URL: https://docs.runloop.ai/docs/storage-objects/overview
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Storage
- Objects
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
Securely manage account-level Secrets (API keys, tokens, credentials) that Runloop injects into Devboxes at runtime. Raw secret values are never exposed to agent code or to the Devbox shell environment after creation — they are referenced by name.
- Human URL: https://docs.runloop.ai/docs/devboxes/configuration/account-secrets
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Secrets
- Credentials
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
Define and manage egress Network Policies that restrict outbound network access from Devboxes. Allow/deny rules at account scope, attachable per Devbox at launch.
- Human URL: https://docs.runloop.ai/docs/network-policies
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Network Policy
- Security
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
Configure Agent Gateways — proxy configurations that let Devbox-resident agents call external AI provider APIs (OpenAI, Anthropic, etc.) without exposing the raw provider credentials to agent code. Implements the Credential Gateway / opaque token-injection security pattern.
- Human URL: https://docs.runloop.ai/docs/devboxes/agent-gateways
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Agent Gateways
- Credential Proxy
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
Configure and manage Model Context Protocol (MCP) server bindings for Devboxes. Each MCP Config is a declarative mount that Runloop wires into Devbox agent runtimes so the agent can call MCP tools without bespoke setup.
- Human URL: https://docs.runloop.ai/docs/devboxes/mcp
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- MCP
- Model Context Protocol
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
Create and manage Runloop account API keys and Restricted Keys (scoped, narrower-permission tokens). API keys are the standard auth credential for SDK and REST API access; Restricted Keys are intended for embedded use in Devbox-resident agents.
- Human URL: https://docs.runloop.ai/api-reference/apikeys/create-api-key
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- API Keys
- Authentication
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- JSON Schema — JSON Schema
- JSON Schema — JSON Schema
Stream stdout and stderr updates from in-flight Devbox executions in real time. Use alongside the Devbox execute endpoints for long-running command output capture.
- Human URL: https://docs.runloop.ai/docs/devboxes/execution-logs
- Base URL:
https://api.runloop.ai
- AI
- AI Agents
- Executions
- Streaming
- Documentation
- OpenAPI — OpenAPI Specification
- Postman Collection — Postman Collection 2.1
- Open Collection — Open Collection 1.0
- Arazzo Workflows — Arazzo Specification
- Website
- Documentation
- API Reference
- Portal
- Sign Up
- Pricing
- Plans
- Rate Limits
- Fin Ops
- Vocabulary
- Spectral Rules
- JSON-LD — JSON-LD
- Status Page
- Security
- Compliance
- Careers
- About
- Blog
- Media
- Contact Sales
- Git Hub
- Documentation
- Documentation
- Documentation
- Documentation
- Tutorials
- SDK
- SDK
- Python Package
- SDK
- SDK
- N P M Package
- C L I
- C L I
- Homebrew
- SDK
- Tools
- Tools
- Tools
- Tools
- Tools
- Tools
- Tools
- Tools
- Tools
- Integration
- Integration
- Integration
- Integration
- M C P
- Contact Info
FN: Runloop, Inc. Email: support@runloop.ai URL: https://runloop.ai