LLM Settings

BaseLLMConfig

Bases: BaseConfig

Base configuration class for LLM.

type = Field(description='Mandatory type field for identifying the LLM type.') class-attribute instance-attribute

OpenAIConfig

Bases: BaseLLMConfig

Configuration class for OpenAI.

type = Field(default='OpenAI', description='Default type for OpenAIConfig.') class-attribute instance-attribute

api_key = Field(alias='OPENAI_API_KEY', description='API key for authentication with OpenAI.') class-attribute instance-attribute

base_url = Field(default=None, description='Custom base URL for OpenAI API.') class-attribute instance-attribute

organization = Field(default=None, description='OpenAI organization ID (if applicable).') class-attribute instance-attribute

max_retries = Field(default=10, description='Maximum number of retries for failed API requests.') class-attribute instance-attribute

request_timeout = Field(default=180.0, description='Request timeout in seconds.') class-attribute instance-attribute