- VLM Providers (Vision Language Models): Process documents visually, extract structured data, classify documents
- OCR Providers: Convert documents to text with layout information
Provider Types
VLM Providers
VLM providers can see document images directly. Use them for:- Direct extraction from visually complex documents
- Document classification and categorization
- Splitting multi-document files
- Quality assessment
OCR Providers
OCR providers convert documents to structured text. Use them for:- High-fidelity text extraction with bounding boxes
- Processing text-heavy documents
- Building RAG pipelines with chunking
Supported Providers
VLM Providers
OCR Providers
Access Methods
VLM providers can be accessed two ways:Via OpenRouter (Recommended)
Single API key for all providers with unified billing:- Single API key for all providers
- Unified billing and usage tracking
- Automatic cost tracking in responses
- Provider fallback without multiple API keys
Native APIs
Direct access to provider APIs:- You have existing API keys
- You need provider-specific features
- You want to avoid the OpenRouter intermediary
Provider Selection
Choose based on your needs:Production Configuration
For production, usebuildLLMProvider with fallback support:
- Retries failed requests up to 2 times
- Falls back to the next provider if one fails
- Uses circuit breaker to skip failing providers
- Applies exponential backoff between retries
Cost Tracking
All providers return cost information:Provider Metadata Utilities
The SDK exports utility functions for querying provider capabilities programmatically:Check Image Support
Check PDF Support
Get Providers for Node Type
Estimate Costs
Compare Access Methods
Access Provider Metadata
ThePROVIDER_METADATA constant provides complete metadata for all providers:
Next Steps
OpenAI
GPT-4.1, o3, o4-mini configuration
Anthropic
Claude models configuration
Gemini models configuration
Mistral OCR
Mistral OCR 3 and Document AI setup
Surya OCR
Datalab Surya OCR setup