Architecture Diagrams

Mermaid diagrams for the LLM platform.

High-level data flow

graph TD
    Users[Management / Staff]
    Users -->|Browser / LLMConnect| WebUI[Open WebUI]
    WebUI -->|HTTP API| Inference[Ollama / Model Server]
    Inference -->|LoRA Adapters| Model[Qwen3 8B]

    Docs[Documents / PDFs] --> OCR[Marker OCR]
    OCR --> Dataset[Normalized Dataset]
    Dataset --> Training[QLoRA Training]
    Training --> Adapters[LoRA Checkpoints]
    Adapters --> Inference

    Dataset <-->|NFS| Storage[Shared Dataset Volume]
    OCR <-->|NFS| Storage
    Training <-->|NFS| Storage

Deployment view (VPN, GPU, storage)

graph TD
    User[Management User] -->|VPN| WebUI[Open WebUI]
    WebUI --> Ollama[Ollama Runtime]
    Ollama --> GPU[RTX 3070]

    OCRVM[OCR VM] -->|NFS| Storage[NVMe Dataset]
    TrainingVM[Training VM] -->|NFS| Storage
    TrainingVM --> GPU