AI / LLM Python

Sovereign SRE

Detect → Diagnose → Fix → Deploy, all without paging anyone.

LangGraphAmazon BedrockAWSCrewAI
MonitorAI AgentCodebase AnalysisHuman GateFix DeployPrometheus · LangGraph · CrewAI · ArgoCD
System architecture

01 Background

Production systems fail in unpredictable ways. Traditional SRE relies on human engineers on-call, following runbooks, and debugging under extreme pressure, an expensive, error-prone process at scale. Sovereign SRE closes this loop autonomously: CloudWatch alarms route through EventBridge and Lambda into a LangGraph state machine, where CrewAI agents diagnose the incident using codebase embeddings stored in RDS pgvector, then Bedrock Claude Haiku generates a targeted code patch. The entire pipeline is orchestrated by Step Functions, which pauses for a mandatory human approval via SNS email before any fix is deployed. Every incident is fully auditable: diffs in S3, history in DynamoDB, cost metrics in CloudWatch.

02 How It Works

01

Alarm Ingestion

CloudWatch monitors logs and custom metrics. ERROR/CRITICAL severity events trigger an alarm that routes through EventBridge to a Lambda handler, which initiates the Step Functions execution.

02

Step Functions Orchestration

AWS Step Functions coordinates the full healing pipeline using a waitForTaskToken pattern: the workflow pauses at the approval gate and resumes only when the engineer responds via the SNS email link.

03

Multi-Agent Root Cause Analysis

LangGraph runs a typed state machine through CrewAI agents: a Senior SRE agent diagnoses the incident and a System Researcher agent queries the codebase via LlamaIndex RAG backed by RDS pgvector embeddings.

04

Bedrock Patch Generation

Amazon Bedrock (Claude Haiku) generates a targeted code patch with a diff preview. Groq Llama 3.3 serves as a fallback LLM. GitHub integration automatically opens a PR with the proposed fix.

05

Human Approval Gate

The engineer receives an SNS email with approve/reject links (1-hour expiry). On approval, Step Functions resumes and the fix is deployed. All outcomes are logged to DynamoDB and artifacts stored in S3.

03 Results & Impact

Full incident-to-fix pipeline runs on 13 AWS services across compute, storage, messaging, and AI inference

Step Functions waitForTaskToken pattern ensures no autonomous deployment without engineer sign-off

RDS pgvector RAG retrieves codebase context for accurate, targeted patch generation

31 passing tests with full AWS service mocking via moto, CI-ready from day one

Live deployment: dashboard on AWS Amplify, API on EC2, vector DB on RDS (us-east-2)