Skip to content

LLM Manager Example

18+ LLM Providers

Part of 400+ modules supporting OpenAI, Anthropic, Gemini, Azure, AWS Bedrock, and more. See LLM Documentation.

Python
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
import logging

logger = logging.getLogger(__name__)

from agenticaiframework.llms import LLMManager

# Example: Using the LLMManager
# -----------------------------
# This example demonstrates how to:
# 1. Create an LLMManager
# 2. Register LLM models
# 3. Generate text using a registered model
#
# Expected Output:
# - Generated text from the selected model

if __name__ == "__main__":
    # Create an LLM manager
    llm_manager = LLMManager()

    # Define a mock LLM function
    def mock_llm(prompt):
        return f"Generated response for: {prompt}"

    # Register the mock LLM
    llm_manager.register_model("MockLLM", mock_llm)

    # Generate text using the registered model
    prompt_text = "What is the capital of France?"
    response = llm_manager.generate("MockLLM", prompt_text)
    logger.info("LLM Response:", response)