Skip to content

assembly_configuring_llm.adoc

Latest commit

 

History

History
46 lines (31 loc) · 1.65 KB

assembly_configuring_llm.adoc

File metadata and controls

46 lines (31 loc) · 1.65 KB

Configuring large language models for analysis

{mta-dl-plugin} provides the large language model (LLM) with the contextual prompt, migration hints, and solved examples to generate suggestions for resolving issues identified in the current code.

{mta-dl-plugin} is designed to be model agnostic. It works with LLMs that are run in different environments (in local containers, as local AI, or as a shared service) to support analyzing Java applications in a wide range of scenarios. You can choose an LLM from well-known providers, local models that you run from Ollama or Podman Desktop, and OpenAI API compatible models.

The code fix suggestions produced to resolve issues detected through an analysis depend on the LLM’s capabilities.

You can run an LLM from the following generative AI providers:

  • OpenAI

  • Azure OpenAI

  • Google Gemini

  • Amazon Bedrock

  • Ollama

You can also run OpenAI API-compatible LLMs deployed as:

  • A service in your {ocp-name} AI cluster

  • Locally in the Podman AI Lab in your system.