System Architecture
How cognitive runs are produced, monitored, and archived.
Data Flow
Components
Runner
Orchestration EngineThe Runner is the core execution engine that orchestrates cognitive runs. It manages the lifecycle of each run, coordinates task execution, and ensures proper checkpoint creation.
Responsibilities
- •Initialize and configure run environment
- •Execute cognitive tasks in sequence
- •Manage state transitions between phases
- •Trigger checkpoint creation at defined intervals
Events
Telemetry PipelineThe event system captures and streams all observable actions during a run. Every metric emission, state change, and checkpoint is wrapped in an EventEnvelope.
Responsibilities
- •Wrap all observations in EventEnvelope format
- •Maintain monotonic sequence ordering
- •Stream events to consumers in real-time
- •Persist events to events.jsonl
Rollups
Metric AggregationThe rollup service consumes the event stream and computes aggregate metrics. It maintains running calculations for UARI dimensions and other key indicators.
Responsibilities
- •Compute UARI stance metrics from events
- •Calculate rolling averages and trends
- •Detect anomalies and threshold violations
- •Emit aggregated metrics for visualization
Dashboard
Real-time VisualizationThe dashboard provides real-time visibility into active runs. It consumes rollup metrics and displays them as charts, gauges, and event streams.
Responsibilities
- •Display live UARI metrics
- •Render telemetry time series
- •Show event stream with filtering
- •Enable run selection and comparison
Bundles
Artifact StorageThe bundle system creates immutable, cryptographically-signed artifact packages for each checkpoint. These enable full reproducibility.
Responsibilities
- •Package checkpoint artifacts
- •Compute and verify SHA checksums
- •Generate cryptographic signatures
- •Store bundles in addressable format
Key Data Formats
events.jsonl
Newline-delimited JSON file containing all events from a run.
{"id":"...","type":"checkpoint",...}
{"id":"...","type":"metric",...}
{"id":"...","type":"log",...}manifest.json
Bundle metadata including checksums and signatures.
{
"run_id": "run-2024-001",
"checkpoint": "47",
"sha": "a1b2c3d4...",
"timestamp": "..."
}