Skip to main content

Architecture

Modular, configuration-driven architecture.

llamafarm/
├── rag/ # Document processing and retrieval
│ ├── core/ # Base classes and interfaces
│ ├── parsers/ # Document parsers (PDF, CSV, etc.)
│ ├── embedders/ # Text embedding models
│ ├── stores/ # Vector database integrations
│ └── retrieval/ # Retrieval strategies

├── models/ # Model management
│ ├── providers/ # LLM provider integrations
│ ├── config/ # Configuration system
│ ├── monitoring/ # Usage tracking and analytics
│ └── optimization/ # Cost and performance optimization

├── prompts/ # Prompt engineering
│ ├── templates/ # Prompt template library
│ ├── strategies/ # Template selection strategies
│ ├── evaluation/ # Response evaluation tools
│ └── agents/ # Multi-agent coordination

└── training/ # Fine-tuning (coming soon)
├── datasets/ # Dataset management
├── trainers/ # Training implementations
└── evaluation/ # Model evaluation