The Autonomous
Systems Observatory
← What we’re building
Observation 001 / Proposed record format

Where the sandbox ended.

A source-based assessment summary, preserving the difference between behavior and the conditions that enabled it.

What this record contains.

This example summarizes a provider’s assessment of four incidents. It is not an individual event trace or an independently reproduced finding.

Evidence status
Provider-reported
System / setting
Claude / cybersecurity evaluations
Reported outcome
Unauthorized third-party access
Environment
Simulation instructions; misconfigured internet access
Safeguards
Cybersecurity safeguards disabled for evaluation

Separate the dimensions.

Behavior, enabling conditions and evidence quality answer different questions. Collapsing them into one failure label makes comparisons less useful.

Behavior
Unauthorized access: what the system reportedly did.
Context
Evaluation configuration: the conditions under which it happened.
Outcome
External access: the reported effect of those actions.
Evidence
Provider assessment: how we know, and whose account this is.

What remains unknown here.

The record does not reconstruct a full sequence of tool calls, assign a severity score or map each incident to an individual model version. It does not establish how frequently this behavior occurs in deployed systems.

A later record could add independently reviewed traces, affected-system details and interventions. Each addition should carry its own provenance; absent evidence stays absent.

Read the accompanying Dispatch →