Skip to main content
ABBYY Vantage integrates external LLM providers through LLM connections, using credentials you supply for that provider or endpoint. The following providers are supported.

Supported providers

The models listed are examples, not a complete list. Enter the exact model or deployment name that your provider account supports.
ABBYY Phoenix Plus is not listed above. It is an LLM endpoint ABBYY supplies and operates, so it has no connection fields to configure and its model is selected by ABBYY rather than by you. See LLMs in ABBYY Vantage.
To set up a connection to any of these providers, see Configure LLM connections.

Anthropic

Direct access to Anthropic’s Claude models with a simple, API-key-only setup. Best for organizations that want to use Claude models for extraction and classification.
  • Connection fields: Model Name and API Key (starts with sk-). An Optional section adds Upstream API Base.
  • Document data is processed on Anthropic’s infrastructure, subject to Anthropic’s terms and data policies.

Google AI Studio (Gemini)

Google’s Gemini models through AI Studio, with a simple, API-key-only setup. Best for cost-effective access to multimodal models, especially for organizations already using Google Cloud.
  • Connection fields: Model Name and API Key. An Optional section adds API Base.
  • Document data is processed on Google’s infrastructure, subject to Google’s terms and data policies. Model availability may vary by region.

Microsoft Foundry

OpenAI and other AI models hosted on Microsoft’s Azure infrastructure. Best for enterprise deployments that need data-residency controls, Azure integration, or custom model hosting.
  • Connection fields: Model Name (the exact name of your deployed model), API Base (the full endpoint, including the deployment path and API version), and Azure API Key.
  • Available models may differ from OpenAI direct. Suited to organizations with an existing Azure subscription and compliance requirements.

Mistral AI

Direct access to Mistral AI’s models with a simple, API-key-only setup. Best for organizations that want Mistral models, including cost-effective options for high-volume extraction.
  • Connection fields: Model Name and API Key.
  • Document data is processed on Mistral AI’s infrastructure, subject to Mistral AI’s terms and data policies.

OpenAI

Direct access to OpenAI models with a simple, API-key-only setup. Best for organizations already using the OpenAI platform.
  • Connection fields: Model Name and OpenAI API Key (starts with sk-). An Optional section adds API Base and OpenAI Organization ID.
  • Document data is processed on OpenAI’s infrastructure, subject to OpenAI’s terms and data policies.

Custom (OpenAI-Compatible)

An endpoint you host or control that implements the OpenAI chat completions API. Best for a privately hosted model, or for a provider that is not in the list.
  • Connection fields: Model Name (the name your endpoint serves), API Base (the endpoint’s base URL, for example https://my-llm.example.com/v1), and API Key.
  • The endpoint must be reachable from your ABBYY Vantage deployment over http or https. Vantage checks the URL format when you save the connection, and reachability only when you test it.
  • Document data is processed wherever that endpoint runs, under whatever terms apply to it.