Overview

LLMDB is a fast, zero-network LLM model metadata catalog for Elixir. It ships a pre-built snapshot of model metadata from every major LLM provider and serves it from :persistent_term for O(1), lock-free reads. Query with a simple "provider:model" spec and get back a validated struct with token limits, pricing, capabilities, modalities, and lifecycle status.

Purpose

LLMDB serves as the model metadata backbone for the Jido ecosystem. It gives every package in the stack a single, validated source of truth about what each LLM model can do, what it costs, and how to talk to it.

Major Components

Public API (LLMDB)

model/1, models/0, providers/0, select/1, candidates/1, allowed?/1, parse/1 — all O(1) reads from persistent_term.

Model & Provider Structs

Zoi-validated structs covering limits, costs, capabilities, modalities, tags, aliases, and lifecycle status.

Store (LLMDB.Store)

Persistent-term-backed runtime store with atomic snapshot swaps, O(1) lookups, and provider aliasing.

Engine (LLMDB.Engine)

Build-time ETL pipeline: Ingest → Normalize → Validate → Merge → Finalize → Ensure Viable. Eight data sources including OpenRouter, models.dev, and provider-specific APIs.

Query (LLMDB.Query)

Capability-based model selection with require, forbid, prefer, and scope options.