Skip to content

LLM Manager

BaseLLMManager

Bases: ABC

Base class for LLM implementations.

__init__(config)

Initialize the base LLM manager.

Parameters:

get_llm() abstractmethod

Retrieve the initialized LLM instance.

Returns:

  • Any

    The initialized LLM instance.

OpenAIManager

Bases: BaseLLMManager

Manages an asynchronous OpenAI instance for LLM operations.

__init__(config)

Initialize OpenAIManager with OpenAI settings.

Parameters:

  • config (OpenAIConfig | Dict | str | Path) –

    Configuration for OpenAI settings.

Raises:

  • ValueError

    If the API key is not provided in the configuration.

get_llm()

Retrieve the initialized async OpenAI instance.

Returns:

  • AsyncOpenAI

    The initialized OpenAI instance.