Feature Request: CometAPI Integration

[TensorNull]

Feature Request: CometAPI Integration

Summary

We are the official development team of CometAPI (https://www.cometapi.com/), requesting to integrate CometAPI as a new endpoint in LibreChat. CometAPI provides access to 500+ AI models through a unified API, including the latest models like GPT-5, Claude Opus 4.1, O3-Deep-Research, and many others.

Motivation

CometAPI offers several advantages that would benefit the LibreChat community:

1. Unified Access: Single API endpoint for 500+ AI models from various providers
2. Latest Models: Access to cutting-edge models including GPT-5 series, Claude Opus 4.1, O3-Deep-Research
3. Cost Efficiency: Competitive pricing and free tokens for new users
4. Reliability: Enterprise-grade infrastructure with high availability
5. OpenAI Compatibility: Full compatibility with OpenAI API format, making integration seamless

Proposed Implementation

1. Configuration Structure

Add CometAPI as a custom endpoint in librechat.yaml:

endpoints:
  custom:
    - name: 'CometAPI'
      apiKey: '${COMETAPI_API_KEY}'
      baseURL: 'https://api.cometapi.com/v1'
      models:
        default: [
          'gpt-5',
          'gpt-5-mini', 
          'gpt-5-nano',
          'claude-opus-4.1',
          'o3-deep-research',
          'o4-mini-deep-research'
        ]
        fetch: true
      titleConvo: true
      titleModel: 'gpt-5-mini'
      modelDisplayLabel: 'CometAPI'
      iconURL: 'https://www.cometapi.com/favicon.ico'
      headers:
        'User-Agent': 'LibreChat/1.0'

2. Areas of Application Affected

Backend Changes:

• Configuration: Add CometAPI endpoint configuration in api/server/services/Config/EndpointService.js
• Client Initialization: Extend custom endpoint initialization in api/server/services/Endpoints/custom/initialize.js
• Model Fetching: Utilize existing model fetching mechanism for dynamic model discovery
• Authentication: Leverage existing API key management system

Frontend Changes:

• Model Selection: CometAPI models will appear in the model dropdown
• Endpoint Selection: CometAPI will be available as an endpoint option
• UI Integration: Seamless integration with existing LibreChat interface

Documentation:

• Update configuration documentation to include CometAPI setup instructions
• Add environment variable documentation for COMETAPI_API_KEY

3. Technical Implementation Details

API Compatibility

CometAPI is fully compatible with OpenAI's API format, which means:

• No custom client implementation required
• Existing OpenAIClient can be used with custom baseURL
• Standard request/response format
• Support for streaming responses
• Compatible with existing error handling

Environment Variables

COMETAPI_API_KEY=your_cometapi_key_here

Model Support

CometAPI supports various model categories:

• Text Generation: GPT-5 series, Claude Opus 4.1, O3-Deep-Research
• Code Generation: Specialized coding models
• Multimodal: Vision and text processing capabilities
• Specialized: Domain-specific models for various use cases

4. Benefits for LibreChat Users

1. Expanded Model Access: Access to 500+ models including the latest releases
2. Cost Optimization: Competitive pricing and free tier availability
3. Performance: High-performance infrastructure with global CDN
4. Reliability: Enterprise-grade uptime and support
5. Innovation: Early access to cutting-edge AI models

5. Maintenance Commitment

As the official CometAPI development team, we commit to:

• Long-term Support: Ongoing maintenance and updates for the integration
• Bug Fixes: Prompt resolution of any integration-related issues
• Feature Updates: Regular updates to support new CometAPI features
• Documentation: Comprehensive documentation and examples
• Community Support: Active participation in LibreChat community discussions

6. Testing Strategy

We will provide comprehensive testing including:

• Unit Tests: Test CometAPI client initialization and configuration
• Integration Tests: End-to-end testing with various CometAPI models
• Error Handling: Test API key validation and error scenarios
• Performance Tests: Ensure optimal performance with CometAPI endpoints

7. Migration Path

For existing users:

• Non-breaking: Integration will not affect existing configurations
• Optional: CometAPI will be an additional option, not a replacement
• Gradual Adoption: Users can migrate gradually or use alongside existing endpoints

Implementation Timeline

1. Phase 1 (Week 1-2): Core integration and basic functionality
2. Phase 2 (Week 3): Advanced features and optimization
3. Phase 3 (Week 4): Testing, documentation, and community feedback
4. Phase 4 (Week 5): Final refinements and production readiness

Additional Information

• CometAPI Documentation: https://api.cometapi.com/doc
• Discord Community: https://discord.com/invite/HMpuV6FCrG

We are excited to contribute to the LibreChat ecosystem and provide users with access to the latest AI models through our robust API platform. We look forward to collaborating with the LibreChat maintainers and community to make this integration successful.