System Architecture

How cognitive runs are produced, monitored, and archived.

Data Flow

RunnerEventsRollupsDashboardBundlesInputOutput

Components

R

Runner

Orchestration Engine

The Runner is the core execution engine that orchestrates cognitive runs. It manages the lifecycle of each run, coordinates task execution, and ensures proper checkpoint creation.

Responsibilities

  • Initialize and configure run environment
  • Execute cognitive tasks in sequence
  • Manage state transitions between phases
  • Trigger checkpoint creation at defined intervals
E

Events

Telemetry Pipeline

The event system captures and streams all observable actions during a run. Every metric emission, state change, and checkpoint is wrapped in an EventEnvelope.

Responsibilities

  • Wrap all observations in EventEnvelope format
  • Maintain monotonic sequence ordering
  • Stream events to consumers in real-time
  • Persist events to events.jsonl
R

Rollups

Metric Aggregation

The rollup service consumes the event stream and computes aggregate metrics. It maintains running calculations for UARI dimensions and other key indicators.

Responsibilities

  • Compute UARI stance metrics from events
  • Calculate rolling averages and trends
  • Detect anomalies and threshold violations
  • Emit aggregated metrics for visualization
D

Dashboard

Real-time Visualization

The dashboard provides real-time visibility into active runs. It consumes rollup metrics and displays them as charts, gauges, and event streams.

Responsibilities

  • Display live UARI metrics
  • Render telemetry time series
  • Show event stream with filtering
  • Enable run selection and comparison
B

Bundles

Artifact Storage

The bundle system creates immutable, cryptographically-signed artifact packages for each checkpoint. These enable full reproducibility.

Responsibilities

  • Package checkpoint artifacts
  • Compute and verify SHA checksums
  • Generate cryptographic signatures
  • Store bundles in addressable format

Key Data Formats

events.jsonl

Newline-delimited JSON file containing all events from a run.

{"id":"...","type":"checkpoint",...}
{"id":"...","type":"metric",...}
{"id":"...","type":"log",...}

manifest.json

Bundle metadata including checksums and signatures.

{
  "run_id": "run-2024-001",
  "checkpoint": "47",
  "sha": "a1b2c3d4...",
  "timestamp": "..."
}