Architecture

System Overview

┌─────────────────┐
│     AGENT       │
│  Proof of       │──┐
│  Civitas SDK    │  │
└─────────────────┘  │
                     │ Request LLM Inference:
                     │ (Message, Model)
                     ▼
┌─────────────────────────────┐
│       THE NETWORK           │
│     Proof of Civitas SDK    │
└─────────────────────────────┘
         │                 ▲
         │                 │
         │ Secure          │ Inference Response:
         │ Processing      │ (Message, Proof)
         ▼                 │
┌─────────────────────────────┐
│         SOLANA              │
│   On- & Off-Chain Ledger    │
└─────────────────────────────┘
         ▲
         │
         │ Store: (Message, Proof)
         │
┌─────────────────────────────┐
│         AGENT               │
│   Read & Verify             │
│   (Message, Proof)          │
└─────────────────────────────┘

The Flow

1. Agent Request: The agent sends a request containing a message with the desired LLM model to the TEE

2. Secure Processing: The TEE securely processes the request by calling the LLM API

3. Return Proof: The TEE sends back {Message, Proof} to the agent

4. On-Chain Storage: The TEE submits the attestation with {Message, Proof} to Solana

5. Verification: The Proof of Civitas SDK is used to read the attestation from Solana and verify it with {Message, Proof}. The proof log can be added to the agent website/app

Technical Components

Trusted Execution Environment (TEE)

• LLM inference executed inside Amazon Nitro Enclaves

• Enclave cannot be accessed from outside to ensure agent security

• Includes instructions to verify code running inside TEEs

Proof of Civitas SDK

• OpenAI-compatible Python & JavaScript libraries

• Makes verifiable LLM inferences within your agent

• Supports OpenAI and Claude LLMs, plus fine-tuned models with OpenAI

• Logging functionality to retrieve and display verified inferences

• Verification logic to validate in code if a proof is correct

Solana Integration

• On-chain verifiability with Solana blockchain

• Transparent, immutable proof storage

• Public verification without centralized trust