Llm settings
MAX_TOKENS_MAP = {LLMProviders.OPENAI: 128000, LLMProviders.ANTHROPIC: 200000, LLMProviders.FAKE: 10000}
module-attribute
AnthropicModels
Bases: StrEnum
claude_3_5_haiku = 'claude-3-5-haiku-latest'
class-attribute
instance-attribute
claude_3_5_sonnet = 'claude-3-5-sonnet-latest'
class-attribute
instance-attribute
claude_3_haiku = 'claude-3-haiku-20240307'
class-attribute
instance-attribute
claude_haiku = 'claude-3-5-haiku-latest'
class-attribute
instance-attribute
claude_sonnet = 'claude-3-5-sonnet-latest'
class-attribute
instance-attribute
FakeModels
Bases: StrEnum
Fake models for testing purposes.
Each is set up to return a FakeLLM when the LLMProvider is called. Note: Works with both real and fake LLMProvider (FakeLLMProvider only adds extra check that a FakeLLM is being used). The result is that any of these LLMs can be used in local testing or via langgraph sdk.
echo_only = 'echo_only'
class-attribute
instance-attribute
fake_call_sub_assistant = 'fake_call_sub_assistant'
class-attribute
instance-attribute
fake_message_search_tool_call = 'fake_message_search_tool_call'
class-attribute
instance-attribute
fake_tavily_tool_call = 'fake_tavily_tool_call'
class-attribute
instance-attribute
LLMModels
Bases: SimpleNamespace
anthropic = AnthropicModels
class-attribute
instance-attribute
fake = FakeModels
class-attribute
instance-attribute
openai = OpenaiModels
class-attribute
instance-attribute
LLMProviders
Bases: StrEnum
ANTHROPIC = 'anthropic'
class-attribute
instance-attribute
COHERE = 'cohere'
class-attribute
instance-attribute
FAKE = 'fake'
class-attribute
instance-attribute
GOOGLE = 'google'
class-attribute
instance-attribute
NOT_SET = 'not_set'
class-attribute
instance-attribute
OPENAI = 'openai'
class-attribute
instance-attribute
LLMSettingsSchema
Bases: ConfigSchemaBase
max_tokens = Field(default=1000, description='Max tokens for response if supported')
class-attribute
instance-attribute
model = LLMModels.openai.gpt4o_mini
class-attribute
instance-attribute
provider = LLMProviders.OPENAI
class-attribute
instance-attribute
temperature = 0.5
class-attribute
instance-attribute
OpenaiModels
Bases: StrEnum