LlamaIndex SDK

Use LlamaIndex through Keywords AI

This integration is for the Keywords AI gateway.

Overview

LlamaIndex provides a powerful framework for building LLM applications with data. You can seamlessly integrate Keywords AI with LlamaIndex’s OpenAI LLM with minimal code changes.

Quickstart

Step 1: Install LlamaIndex

Python

pip install llama-index-llms-openai

Step 2: Initialize LlamaIndex with Keywords AI

Python

from llama_index.llms.openai import OpenAI

llm = OpenAI(
    api_base="https://api.keywordsai.co/api/",
    api_key="<Your Keywords AI API Key>",
    model="gpt-3.5-turbo"
)

Step 3: Make Your First Request

Python

response = llm.complete("Hello, world!")
print(response)

Switch models

Python

# OpenAI GPT models
model = "gpt-4o"
# model = "claude-3-5-sonnet-20241022"
# model = "gemini-1.5-pro"

llm = OpenAI(
    api_base="https://api.keywordsai.co/api/",
    api_key="<Your Keywords AI API Key>",
    model=model
)

See the full model list for all available models.

Supported parameters

OpenAI parameters

We support all the OpenAI parameters. You can pass them directly in the LlamaIndex configuration.

Python

llm = OpenAI(
    api_base="https://api.keywordsai.co/api/",
    api_key="<Your Keywords AI API Key>",
    model="gpt-4o-mini",
    temperature=0.7,          # Control randomness
    max_tokens=1000,          # Limit response length
)

Keywords AI Parameters

Keywords AI parameters can be passed using extra_body for better handling and customization.

Python

response = llm.complete(
    "Tell me a story",
    extra_body={
        "customer_identifier": "user_123",           # Track specific users
        "fallback_models": ["gpt-3.5-turbo"],       # Automatic fallbacks
        "metadata": {"session_id": "abc123"},        # Custom metadata
        "thread_identifier": "conversation_456",     # Group related messages
        "group_identifier": "team_alpha",           # Organize by groups
    }
)

View your analytics

Access your Keywords AI dashboard to see detailed analytics

Next Steps

Advanced settings

Track user behavior and patterns

Prompt Management

Manage and version your prompts