AI: Support for other/own AI models
N
Nabilah Binti Salleh
Business Problem:
Some businesses require advanced flexibility and control over the AI models they use for customer communication. The current AI setup does not allow users to integrate their own LLM models.
Desired Outcome:
Enable users to connect their own AI models—whether hosted on their own infrastructure or a third-party provider—via API to power Respond AI Agents. This would give businesses full control over the model's behavior, data processing, and compliance.
A
Alyaa See
Merged in a post:
Option to change ai model
Alex Kemsley
Option to change the ai model that is used and specify your own API key.
For example Gemini and claude.
N
Nabilah Binti Salleh
Merged in a post:
Support for using other AI models (Anthropic) in AI Agents
Bryan Santos
We would like respond.io AI Agents to be able to use other vendors/models besides OpenAI. In particular, we are interested in being able to use Anthropic models (for example, Claude) as an engine for the AI Agent.
Main use cases:
- Choose the AI vendor/model that best fits our internal policies and compliance requirements.
- Compare quality of responses between different models (OpenAI vs Anthropic) for our specific use case.
- Leverage existing agreements with other AI providers
Desired requirements:
- Possibility to select the AI provider per Agent (OpenAI, Anthropic, etc.).
- Option to bring our own API key from the chosen provider (BYO-Key).
- Keep all other functionalities of the AI Agent the same (use of instructions, knowledge sources, etc.).
N
Nabilah Binti Salleh
Merged in a post:
Alternative AI models
Inpulza Agency
We need to be able to use our own subscription models and APIs like Gemini. It is something vital to continue
N
Nabilah Binti Salleh
Merged in a post:
AI Agent: Allow use of own API keys
I
Isaac Meneses
Business Problem
The AI models in use (e.g., OpenAI, Anthropic, Google) are external services and not native to Respond.io. As a result, businesses end up constrained by platform credits even if they already have separate subscriptions with these providers.
Desired Outcome
Enable customers to connect their own API keys from supported AI providers (e.g., OpenAI, Anthropic, Google) and choose whether to use those credits or Respond.io’s AI Credits.
Benefits
- Scalability: Users can take full advantage of their own AI provider limits without being capped by Respond.io’s credit system.
- Cost optimization: Avoids double paying — once for Respond.io’s plan and again for credits directly from the AI provider.
- Flexibility: Lets businesses choose their preferred AI provider and switch easily as needed.
- Increased adoption: Power users won’t hesitate to expand AI usage since they’re not restricted by platform credit ceilings.
Example Implementation
- A new tab under Settings > Integrations > AI to input and manage API keys.
- A toggle option: “Use Respond.io AI Credits” vs “Use my own API Key.”
N
Nabilah Binti Salleh
Merged in a post:
Respond AI: Add more AI models (e.g. Claude)
Maher Hasan
Claude AI model has more features in some aspects. For example it supports some more languages like Kurdish which is not supported by ChatGPT.