Skip to content

ollama trying to pull custom modelΒ #145

@shirofaii

Description

@shirofaii

Describe the bug

When you add custom model for ollama (with id "custom" for example) provider trying to pull this model and failed

Steps to reproduce the bug

Steps to reproduce:

  1. Create custom model with id="custom" for ollama
  2. Run clean ollama server without any model loaded
  3. Compile and run this code
using LangChain.Providers.Ollama;
using Ollama;

var provider = new OllamaProvider("http://127.0.0.1:11434/api");
var llm = new OllamaChatModel(provider, "custom");

var result = await llm.GenerateAsync("Hi!");

Actual result: provider trying to pull model "custom" and fail

Expected behavior

ollama load existed model "custom" and generate valid response

Screenshots

No response

NuGet package version

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions