Skip to content

Apple Foundation Models LLM Platform #129

@PSchmiedmayer

Description

@PSchmiedmayer

Use Case

We should enable the usage of the Apple Foundation Models APIs to facilitate a common API surface for LLM inference.

Problem

Add a Apple Foundation Models APIs platform.

Solution

Add an Apple Foundation Models APIs platform; it should mirror the setup found for the other platforms, ideally being easily replaceable with the Local setup. Structured output generation should be part of the feature set, see #128 for some context.

Alternatives considered

Additional context

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct and Contributing Guidelines

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    Status

    Next Steps

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions