DIAL Core

DIAL Core exposes a single and OpenAI compatible protocol for communication between internal and external clients, including all AI models and applications, and enabling access to DIAL features in a governed and unified manner.

It streamlines communication and fosters interoperability by eliminating the need for multiple protocols for each integration and enables and future-proof development of GenAI applications.

DIAL Core functions as a unified gateway to language and embedding models from all major (Amazon Bedrock, Google Vertex AI, and Azure OpenAI) and alternative vendors, as well fine-tuned micro models, self-hosted models and models listed on HuggingFace or DeepSeek.

Compatibility with OpenAI enables swift creation and integration of new model adapters.

DIAL Load Balancer employs intelligent algorithms enabling creation of custom and flexible mechanisms of load distribution across model deployments, regions, and cloud subscriptions, prioritizing PTU deployments before using per-token-cost options.

DIAL offers native support for OpenID Connect and OAuth2, integrating with popular Identity Providers like AWS Cognito, Auth0, Google Identity, Microsoft Entra ID, and Okta.

The system enables centralized attribute and role-based access control to all resources with granular permission management tailored to your organizations needs.

DIAL Core enables comprehensive usage and cost control by allowing configuration of token usage, request limits, and monetary costs—customizable for individual users, groups, or API keys.

DIAL leverages OpenTelemetry (OTEL) to provide comprehensive system observability with a vendor-agnostic approach to collecting and analyzing telemetry data. This delivers unified visibility, deep insights into system behavior, and simplified monitoring through standardized data collection and visualization tools.

DIAL Core uses Interceptors to add custom logic to in/out requests for models and apps, enabling PII obfuscation, guardrails, safety checks, and beyond. This framework supports Responsible AI approaches and helps enforce compliance with privacy regulations and policies.

DIAL manages sensitive information according to industry best practices to ensure compliance with PII regulations. The system gives you control over log storage, data retention policies, and helps implement appropriate safeguards for sensitive resources.

DIAL Core seamlessly integrates with all your GenAI applications and agents, regardless of their original platform. Build and integrate with DIAL solutions having freedom to employ a technology of your choice, be it any LLM framework, LlamaIndex, LangChain, Semantic Kernel, vector DBs or any other.