Skip to content

Add OpenAI Support to LLM Abstraction #208

@bhouston

Description

@bhouston

Add OpenAI Support to LLM Abstraction

Currently, the LLM abstraction in MyCoder only supports Anthropic models. We need to add support for OpenAI models to provide users with more options and flexibility.

Tasks

  • Add OpenAI SDK as a dependency
  • Create OpenAI provider implementation
  • Update provider registry to include OpenAI
  • Update configuration to enable OpenAI models
  • Add tests for OpenAI provider
  • Document OpenAI support in README

Implementation Details

  • The OpenAI provider should implement the LLMProvider interface
  • Message format conversion between our internal format and OpenAI's format
  • Support for function/tool calling
  • Support for configuration options (API key, organization, etc.)
  • Token counting for usage tracking

Benefits

  • More model options for users
  • Ability to use GPT-4 and other OpenAI models
  • Flexibility to switch between providers with the same interface

Related

  • This is part of the effort to make MyCoder provider-agnostic

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions