LiteLLM

Use LiteLLM with Keywords AI for logging and gateway access.

This integration supports LiteLLM callbacks (logging) and the Keywords AI gateway.

Overview

LiteLLM provides a unified interface for calling many LLM providers. With Keywords AI, you can either:

• Export logs via LiteLLM callbacks
• Route requests through the Keywords AI gateway

Quickstart

Step 1: Get a Keywords AI API key

Create an API key in the Keywords AI dashboard.

Step 2: Install packages

Python

pip install litellm keywordsai-exporter-litellm

Examples

Choose one of the two ways to use the LiteLLM integration:

Callback mode (logging)

Register the Keywords AI callback to send logs automatically.

Python

import litellm
from keywordsai_exporter_litellm import KeywordsAILiteLLMCallback

callback = KeywordsAILiteLLMCallback(api_key="YOUR_KEYWORDS_AI_API_KEY")
callback.register_litellm_callbacks()

response = litellm.completion(
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

Gateway mode

Route LiteLLM requests through the Keywords AI gateway.

Python

import litellm

response = litellm.completion(
    api_key="YOUR_KEYWORDS_AI_API_KEY",
    api_base="https://api.keywordsai.co/api",
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)

Keywords AI parameters

Callback mode (metadata)

Pass Keywords AI parameters inside metadata.keywordsai_params.

Python

response = litellm.completion(
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello!"}],
    metadata={
        "keywordsai_params": {
            "workflow_name": "simple_logging",
            "span_name": "single_log",
            "customer_identifier": "user-123",
        }
    },
)

Gateway mode (extra_body)

Pass Keywords AI parameters using extra_body when routing through the gateway.

Python

response = litellm.completion(
    api_key="YOUR_KEYWORDS_AI_API_KEY",
    api_base="https://api.keywordsai.co/api",
    model="gpt-4o-mini",
    messages=[{"role": "user", "content": "Hello!"}],
    extra_body={
        "span_workflow_name": "simple_logging",
        "span_name": "single_log",
        "customer_identifier": "user-123",
    },
)

View your analytics

Access your Keywords AI dashboard to see detailed analytics

Next Steps

Advanced settings

Track user behavior and patterns

Prompt Management

Manage and version your prompts