Providers & Models - BoostGPT Documentation

Supported Providers

BoostGPT supports 14 AI providers with 99 models spanning from ultra-fast nano models to advanced reasoning models. Thirteen are hosted for you; Ollama runs on your own machine.

OpenAI

14 models — GPT-6 Astra, GPT-6 Sol, GPT-6 Luna and more

Google

8 models — Gemini 3.6 Flash, Gemini 3.5 Flash, Gemini 3.5 Flash Lite and more

Anthropic

12 models — Claude Fable 5.1, Claude Opus 5.5, Claude Fable 5 and more

xAI

7 models — Grok 4.7, Grok 4.6, Grok 4.5 and more

Zhipu AI

8 models — GLM-4.6, GLM-4.7, GLM-4.7 Flash and more

MiniMax

5 models — MiniMax M3, MiniMax M2.7, MiniMax M2.5

DeepSeek

3 models — DeepSeek V4 Flash, DeepSeek V4 Pro

Moonshot AI

4 models — Kimi K3, Kimi K2.7 Code, Kimi K2.7 Code Highspeed and more

Mistral AI

3 models — Mistral Small, Mistral Medium, Mistral Large

Cohere

5 models — Command A, Command R+, Command R and more

Groq

4 models — DeepSeek Llama (70B), GPT-OSS (20B), GPT-OSS (120B) and more

Fireworks AI

11 models — DeepSeek V3, DeepSeek R1, Llama V3 (8B) and more

Together AI

7 models — Qwen 2.5 Coder (32B), Qwen 2.5 Turbo (72B)

Ollama

4 models — Llama 3.3 (70B) Local, Llama 3.1 (8B) Local, Llama 3.1 (70B) Local and more

Key Features

Bring Your Own API Keys

Use your own API keys for OpenAI, Google, Anthropic, xAI, DeepSeek, Mistral, Cohere, Groq, or Ollama. You control costs and rate limits.

Use Our Infrastructure (Optional)

Don’t have API keys? Use our pooled infrastructure on paid plans. We handle provisioning, rate limits, and scaling.

Reasoning Models

Access advanced reasoning models like O1, O3 Mini, DeepSeek R1, Gemini Flash Thinking, and Claude Extended Thinking for complex problem-solving.

Smart Model Selection

Choose models based on speed, cost, reasoning capability, and context window. Use fast models for simple queries, reasoning models for complex tasks.

Self-Hosted with Ollama

Run models locally using Ollama. Keep data private, eliminate API costs, and use custom fine-tuned models.

Model Categories

Speed-Optimized (Nano/Mini)

Ultra-fast models for simple tasks, high-volume applications, and real-time responses. Best for: FAQs, basic chat, high-traffic bots
Examples: GPT-4.1 Nano, Llama 3.1 Instant (8B), Gemini 2.5 Flash Lite

Balanced (Standard)

Great all-around models balancing speed, cost, and capability. Best for: Most production use cases, customer support, content generation
Examples: GPT-6 Luna, Claude Sonnet 5.5, Gemini 3.8 Flash

Advanced (Pro/Large)

Powerful models for complex tasks requiring deep understanding. Best for: Complex queries, creative writing, technical analysis
Examples: GPT-5, Claude Opus 4.1, Gemini 2.5 Pro

Reasoning Models

Specialized models with extended thinking for complex problem-solving. Best for: Math, coding, logic puzzles, multi-step reasoning
Examples: GPT-6.1 Sol, Claude Opus 5.5, Gemini 3.8 Flash, DeepSeek V4 Pro Learn more about reasoning models →

Model Comparison

Provider	Model	Speed	Cost	Reasoning	Context	Credits per step
OpenAI	GPT-6 Astra	Medium	High	Exceptional	1.05M	39
OpenAI	GPT-6.1 Sol	Medium	Medium	Exceptional	1.05M	8
OpenAI	GPT-6 Luna	Fast	Low	Excellent	1.05M	1
Google	Gemini 3.8 Flash	Fast	Medium	Exceptional	1.05M	3
Google	Gemini 3.5 Flash Lite	Very fast	Very low	Good	1M	2
Anthropic	Claude Fable 5.1	Slow	High	Exceptional	1M	35
Anthropic	Claude Opus 5.5	Medium	High	Exceptional	1M	15
Anthropic	Claude Sonnet 5.5	Fast	Medium	Exceptional	1M	8
Anthropic	Claude Haiku 4.5	Fast	Low	Good	200K	4
xAI	Grok 4.7	Medium	Medium	Exceptional	500K	9
DeepSeek	DeepSeek V4 Pro	Medium	Low	Excellent	1M	5
Groq	GPT-OSS (120B)	Fast	Low	Excellent	131K	2
Ollama	Llama 3.3 (70B) Local	Medium	Very low	Excellent	128K	0

*Ollama runs on your own host, so it uses no credits; your compute is your own. View full comparison →

Using Your Own Models (Ollama)

The only way to use custom models in BoostGPT is through Ollama.

Install Ollama

Download and install Ollama on your server or local machine.

Pull Your Model

    ollama pull llama3.3:70b
    # Or your custom fine-tuned model

Configure BoostGPT

Set your Ollama host URL in the dashboard or via SDK:

    const bot = await client.chat({
      bot_id: 'my-bot-id',
      provider_host: 'http://localhost:11434',  // or your server IP
      model: 'llama3.3:70b',
      message: 'Hello, world!' 
    });

Deploy

Your agent will now use your self-hosted Ollama model. No API costs, full control.

Learn more about Ollama →

Credits System

Your plan includes a monthly credit allowance. Every model call your agent makes uses credits in line with how much it reads and writes and the model’s price, so a short reply on a fast model uses a fraction of a credit and a long agent task on a frontier model uses more.

The model picker shows each model’s credits for a typical agent step, so models can be compared at a glance.
Each message shows the tokens it used and the credits it was charged.
Your own API keys (and your own Ollama host) use no credits.

Agent turns, plain chat replies, chat titles and other AI calls made on your behalf all use credits. Training data and incoming messages don’t.

Choosing the Right Model

For Creators (No-Code Dashboard)

Go to your bot settings
Click “Model Selection”
Choose based on your needs:
- Fast responses → GPT-4o Mini, Gemini Flash Lite
- Best quality → GPT-5, Claude Opus, Gemini Pro
- Complex reasoning → O1, DeepSeek R1
- Low cost → Use nano/mini variants

For Developers (SDK/API)

const bot = await client.createBot({
  name: 'Support Bot',
  model: 'gpt-6-luna', // Fast & affordable
  // Or for complex queries:
  // model: 'gpt-5.4', // Advanced reasoning
});

Provider-Specific Setup

Bring Your Own Keys

Use your existing API keys from any provider

Use Our Infrastructure

Let us handle provisioning (paid plans only)

Next Steps

OpenAI

14 models — GPT-6 Astra, GPT-6 Sol, GPT-6 Luna and more

Google

8 models — Gemini 3.7 Flash, Gemini 3.6 Flash, Gemini 3.5 Flash and more

Anthropic

12 models — Claude Fable 5.1, Claude Opus 5.5, Claude Fable 5 and more

xAI

7 models — Grok 4.7, Grok 4.6, Grok 4.5 and more

Zhipu AI

8 models — GLM-5.3, GLM-5.3 Flash, GLM-5.2 and more

MiniMax

5 models — MiniMax M2.7 Highspeed, MiniMax M2.5 Highspeed, MiniMax M3 and more

DeepSeek

3 models — DeepSeek V4 Flash, DeepSeek V4 Flash Vision, DeepSeek V4 Pro

Moonshot AI

4 models — Kimi K3, Kimi K2.7 Code, Kimi K2.7 Code Highspeed and more

Mistral AI

3 models — Mistral Small, Mistral Medium, Mistral Large

Cohere

5 models — Command A, Command R+, Command R and more

Groq

4 models — GPT-OSS (20B), Qwen 3.8 (27B), Groq Compound and more

Fireworks AI

11 models — DeepSeek V3, DeepSeek R1, Llama V3 (8B) and more

Together AI

7 models — GLM-5.3, GLM-5.2, Kimi K3 and more

Ollama

4 models — Llama 3.3 (70B) Local, Llama 3.1 (8B) Local, Llama 3.1 (70B) Local and more

​Supported Providers

OpenAI

Google

Anthropic

xAI

Zhipu AI

MiniMax

DeepSeek

Moonshot AI

Mistral AI

Cohere

Groq

Fireworks AI

Together AI

Ollama

​Key Features

​Model Categories

​Speed-Optimized (Nano/Mini)

​Balanced (Standard)

​Advanced (Pro/Large)

​Reasoning Models

​Model Comparison

​Using Your Own Models (Ollama)

​Credits System

​Choosing the Right Model

​For Creators (No-Code Dashboard)

​For Developers (SDK/API)

​Provider-Specific Setup

Bring Your Own Keys

Use Our Infrastructure

​Next Steps

OpenAI

Google

Anthropic

xAI

Zhipu AI

MiniMax

DeepSeek

Moonshot AI

Mistral AI

Cohere

Groq

Fireworks AI

Together AI

Ollama

Supported Providers

Key Features

Model Categories

Speed-Optimized (Nano/Mini)

Balanced (Standard)

Advanced (Pro/Large)

Reasoning Models

Model Comparison

Using Your Own Models (Ollama)

Credits System

Choosing the Right Model

For Creators (No-Code Dashboard)

For Developers (SDK/API)

Provider-Specific Setup

Next Steps