⛏ LLM Execution Tools

[hejny]

LlmExecutionTools is a container for all the tools needed to execute prompts to large language models like GPT-4.
On its interface it exposes common methods for prompt execution.
Internally it calls OpenAI, Azure, GPU, proxy, cache, logging,...

LlmExecutionTools an abstract interface that is implemented by concrete execution tools:

• OpenAiExecutionTools
• AnthropicClaudeExecutionTools
• AzureOpenAiExecutionTools
• LangtailExecutionTools
• (Not implemented yet) BardExecutionTools
• (Not implemented yet) LamaExecutionTools
• (Not implemented yet) GpuExecutionTools
• Special case are RemoteLlmExecutionTools that connect to a remote server and run one of the above execution tools on that server.
• Another special case is MockedEchoLlmExecutionTools that is used for testing and mocking.
• The another special case is LogLlmExecutionToolsWrapper that is technically also an execution tools but it is more proxy wrapper around other execution tools that logs all calls to execution tools.

[hejny]

TODO: Write this better + link