Table of Contents

🇫🇷 Version française

See also: LLM providers · Decision models · ADR-015 · Back to the index

Model providers

Orkeon speaks to remote model providers in four categories (ModelProviderCategory, Orkeon.Constants.Llm). A category says what a provider is used for; each keeps its own contract, and there is no interface common to all of them (ADR-015).

Category Contract What it returns Guide
Generation ILlmProvider (Orkeon.Domain) text, tool calls, a stream LLM providers
Embedding IEmbeddingProvider (Orkeon.Application) vectors Memory system, RAG pipeline
Reranking IReranker (Orkeon.Rag.Abstractions) passages in a new order RAG pipeline
Decision IDecisionModel (Orkeon.Application) typed decisions with calibrated probabilities Decision models

The catalogue

ModelProviderCatalog.All lists every remote provider once, with its categories, the variable its API key is read from and its default endpoint:

  • the 16 generation providers, in LlmProviderKeys.All order; OpenAI and Ollama also serve Embedding;
  • the decision providers, which serve Decision only: TypeSafe (TYPESAFE_API_KEY, https://api.typesafe.ai/v1), Liquid (LIQUID_API_KEY, https://api.liquid.ai/decisions/v1) and Kev (no required key, http://127.0.0.1:8009/v1).

ModelProviderCatalog.InCategory(category) filters it, and Find(key) resolves a key or one of its aliases. A test checks that every provider LlmProviderFactory builds is in the catalogue under Generation; scripts/check-doc-claims.py reads the provider count from the code.

The catalogue lists remote services only. A reranker or embedder running in process (ONNX, the local embedding model), and one built over another category (the listwise LLM reranker, the decision reranker) are not providers of their own.

Adding a provider

  • A generation provider follows LLM providers and adds its catalogue line.
  • A provider of another category implements that category's contract and adds its line with its categories. A decision provider is a descriptor of SystemOneDecisionModel when it speaks the System One wire (TypeSafe, Liquid, Kev), otherwise an IDecisionModel of its own; the stages, the guard, the reranker and the tool use it unchanged.
  • A new category adds an enum value and its own port; it never widens ILlmProvider.