Groq

Overview

Groq provides blazing-fast inference for popular open-source models through their custom LPU hardware. Known for exceptional speed while maintaining strong model quality.

Available Models

DeepSeek Llama (70B)

2 credits • Distilled reasoning model

64K context window
Excellent logical capabilities
Speed: Fast • Cost: Low
Reasoning model optimized for efficiency

Llama 3.3 Versatile (70B)

3 credits • Versatile large model

128K context window
Excellent reasoning across diverse tasks
Speed: Fast • Cost: Medium
Best for: General-purpose applications

Llama 3.1 Instant (8B)

1 credit • Ultra-fast small model

128K context window
Good reasoning with minimal latency
Speed: Extremely Fast • Cost: Very Low
Best for: Real-time applications

Qwen QWQ (32B)

2 credits • Multilingual reasoning

32K context window
Excellent reasoning and multilingual
Speed: Fast • Cost: Low
Reasoning model for diverse tasks

Qwen 3 (32B)

2 credits • Next-gen instruction model

32K context window
Excellent instruction-following
Speed: Fast • Cost: Low
Best for: Strong language tasks

Mistral Saba (24B)

2 credits • Reasoning and chat

32K context window
Excellent reasoning
Speed: Fast • Cost: Low
Best for: Balanced performance

LLaMA 4 Maverick (17B 128E)

3 credits • 128 experts model

128K context window
Excellent for advanced instructions
Speed: Medium • Cost: Medium
Best for: Complex instruction tasks

LLaMA 4 Scout (17B 16E)

1 credit • 16 experts model

128K context window
Good for efficient inference
Speed: Fast • Cost: Low
Best for: Lighter workloads

Setup

Using BoostGPT-Hosted API Keys

Select Groq Model

In your BoostGPT dashboard, select any Groq model when creating or configuring your bot.

Choose Your Model

Llama 3.1 Instant: For real-time, ultra-fast responses
Llama 3.3 Versatile: For balanced performance
DeepSeek Llama 70B: For reasoning tasks
Qwen models: For multilingual applications

Using Your Own Groq API Key

Dashboard Setup
Core SDK

Navigate to Integrations

Go to app.boostgpt.co and select Integrations

Select Groq

Find and click on the Groq provider

Add API Key

Enter your Groq API key and select which agents will use this key

Save Configuration

Click save to apply your custom API key

bot.js

import { BoostGPT } from 'boostgpt';

const client = new BoostGPT({
  project_id: process.env.BOOSTGPT_PROJECT_ID,
  key: process.env.BOOSTGPT_API_KEY
});

// Create bot with Groq model
const botResponse = await client.createBot({
  name: 'My Groq Bot',
  model: 'llama-3.1-8b-instant', // Ultra-fast!
  instruction: 'You are a quick and helpful assistant.',
  max_reply_tokens: 1000,
  status: 'active'
});

if (botResponse.err) {
  console.error('Error:', botResponse.err);
} else {
  console.log('Bot created:', botResponse.response);
}

Performance Benefits

Groq’s LPU (Language Processing Unit) hardware provides inference speeds up to 10x faster than traditional GPUs, making it ideal for real-time applications.

Next Steps

Reasoning Models

Learn about reasoning models on Groq

Model Comparison

Compare Groq with other providers

SDK Reference

Full API documentation

Bring Your Own Key

Use your own Groq API key

Getting Started

Choose Your Path

Providers & Models

Overview

Available Models

DeepSeek Llama (70B)

Llama 3.3 Versatile (70B)

Llama 3.1 Instant (8B)

Qwen QWQ (32B)

Qwen 3 (32B)

Mistral Saba (24B)

LLaMA 4 Maverick (17B 128E)

LLaMA 4 Scout (17B 16E)

Setup

Using BoostGPT-Hosted API Keys

Using Your Own Groq API Key

Performance Benefits

Next Steps

Reasoning Models

Model Comparison

SDK Reference

Bring Your Own Key

Getting Started

Choose Your Path

Providers & Models

​Overview

​Available Models

DeepSeek Llama (70B)

Llama 3.3 Versatile (70B)

Llama 3.1 Instant (8B)

Qwen QWQ (32B)

Qwen 3 (32B)

Mistral Saba (24B)

LLaMA 4 Maverick (17B 128E)

LLaMA 4 Scout (17B 16E)

​Setup

​Using BoostGPT-Hosted API Keys

​Using Your Own Groq API Key

​Performance Benefits

​Next Steps

Reasoning Models

Model Comparison

SDK Reference

Bring Your Own Key

Overview

Available Models

Setup

Using BoostGPT-Hosted API Keys

Using Your Own Groq API Key

Performance Benefits

Next Steps