Deprecate Langchain::LLM::LlamaCpp class (#961)

andreibondarev · web-flow · commit 6c82edeb9ce1 · 2025-04-20T16:36:36.000-04:00
diff --git a/.env.example b/.env.example
@@ -12,9 +12,6 @@ GOOGLE_VERTEX_AI_PROJECT_ID=
 GOOGLE_CLOUD_CREDENTIALS=
 GOOGLE_GEMINI_API_KEY=
 HUGGING_FACE_API_KEY=
-LLAMACPP_MODEL_PATH=
-LLAMACPP_N_THREADS=
-LLAMACPP_N_GPU_LAYERS=
 MILVUS_URL=http://localhost:19530
 MISTRAL_AI_API_KEY=
 NEWS_API_KEY=
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -14,6 +14,7 @@
 - [BUGFIX] [https://github.com/patterns-ai-core/langchainrb/pull/939] Fix Langchain::Vectorsearch::Milvus initializer by passing :api_key
 - [BUGFIX] [https://github.com/patterns-ai-core/langchainrb/pull/953] Handle nil response in OpenAI LLM streaming
 - [BREAKING] [https://github.com/patterns-ai-core/langchainrb/pull/956] Deprecate `Langchain::Vectorsearch::Epsilla` class
+- [BREAKING] [https://github.com/patterns-ai-core/langchainrb/pull/961] Deprecate `Langchain::LLM::LlamaCpp` class
 
 ## [0.19.4] - 2025-02-17
 - [BREAKING] [https://github.com/patterns-ai-core/langchainrb/pull/894] Tools can now output image_urls, and all tool output must be wrapped by a tool_response() method
diff --git a/README.md b/README.md
@@ -65,7 +65,6 @@ The `Langchain::LLM` module provides a unified interface for interacting with va
 - Google Gemini
 - Google Vertex AI
 - HuggingFace
-- LlamaCpp
 - Mistral AI
 - Ollama
 - OpenAI
diff --git a/examples/llama_cpp.rb b/examples/llama_cpp.rb
diff --git a/lib/langchain/llm/base.rb b/lib/langchain/llm/base.rb
@@ -14,7 +14,6 @@ class ApiError < StandardError; end
   # - {Langchain::LLM::GoogleGemini}
   # - {Langchain::LLM::GoogleVertexAI}
   # - {Langchain::LLM::HuggingFace}
-  # - {Langchain::LLM::LlamaCpp}
   # - {Langchain::LLM::OpenAI}
   # - {Langchain::LLM::Replicate}
   #
diff --git a/lib/langchain/llm/llama_cpp.rb b/lib/langchain/llm/llama_cpp.rb
@@ -23,6 +23,8 @@ class LlamaCpp < Base
     # @param n_threads [Integer] The CPU number of threads to use
     # @param seed [Integer] The seed to use
     def initialize(model_path:, n_gpu_layers: 1, n_ctx: 2048, n_threads: 1, seed: 0)
+      Langchain.logger.warn "DEPRECATED: `Langchain::LLM::LlamaCpp` is deprecated, and will be removed in the next major version. Please use `Langchain::LLM::Ollama` for self-hosted LLM inference."
+
       depends_on "llama_cpp"
 
       @model_path = model_path

Original file line number	Diff line number	Diff line change
`@@ -14,7 +14,6 @@ class ApiError < StandardError; end`
`14`	`14`	`# - {Langchain::LLM::GoogleGemini}`
`15`	`15`	`# - {Langchain::LLM::GoogleVertexAI}`
`16`	`16`	`# - {Langchain::LLM::HuggingFace}`
`17`		`- # - {Langchain::LLM::LlamaCpp}`
`18`	`17`	`# - {Langchain::LLM::OpenAI}`
`19`	`18`	`# - {Langchain::LLM::Replicate}`
`20`	`19`	`#`