|
| 1 | +# LangChain <> Llama3 Cookbooks |
| 2 | + |
| 3 | +LLM agents use [planning, memory, and tools](https://lilianweng.github.io/posts/2023-06-23-agent/) to accomplish tasks. Agents can empower Llama 3 with important new capabilities. Here, we will show how to give Llama 3 the ability to perform web search, as well as multi-modality: image generation (text-to-image), image analysis (image-to-text), and voice (text-to-speech) tools! |
| 4 | + |
| 5 | +LangChain offers several different ways to implement agents with Llama 3: |
| 6 | + |
| 7 | +(1) `ReAct agent` - Uses [AgentExecutor](https://python.langchain.com/docs/modules/agents/quick_start/) with [tool-calling](https://python.langchain.com/docs/integrations/chat/) versions of Llama 3. |
| 8 | + |
| 9 | +(2) `LangGraph tool calling agent` - Uses [LangGraph](https://python.langchain.com/docs/langgraph) with [tool-calling](https://python.langchain.com/docs/integrations/chat/) versions of Llama 3. |
| 10 | + |
| 11 | +(3) `LangGraph custom agent` - Uses [LangGraph](https://python.langchain.com/docs/langgraph) with **any** version of Llama 3 (so long as it supports structured output). |
| 12 | + |
| 13 | +As we move from option (1) to (3) the degree of customization and flexibility increases: |
| 14 | + |
| 15 | +(1) `ReAct agent` using AgentExecutor is a great for getting started quickly with minimal code, but requires a version of Llama 3 with reliable tool-calling, is the least customizable, and uses higher-level AgentExecutor abstraction. |
| 16 | + |
| 17 | +(2) `LangGraph tool calling agent` is more customizable than (1) because the LLM assistant (planning) and tool call (action) nodes are defined by the user, but it still requires a version of Llama 3 with reliable tool-calling. |
| 18 | + |
| 19 | +(3) `LangGraph custom agent` does not require a version of Llama 3 with reliable tool-calling and is the most customizable, but requires the most work to implement. |
| 20 | + |
| 21 | + |
| 22 | + |
| 23 | +--- |
| 24 | + |
| 25 | +### `ReAct agent` |
| 26 | + |
| 27 | +The AgentExecutor manages the loop of planning, executing tool calls, and processing outputs until an AgentFinish signal is generated, indicating task completion. |
| 28 | + |
| 29 | +Our first notebook, `tool-calling-agent`, shows how to build a [tool calling agent](https://python.langchain.com/docs/modules/agents/agent_types/tool_calling/) with AgentExecutor and Llama 3. |
| 30 | + |
| 31 | +--- |
| 32 | + |
| 33 | +### `LangGraph tool calling agent` |
| 34 | + |
| 35 | +[LangGraph](https://python.langchain.com/docs/langgraph) is a library from LangChain that can be used to build reliable agents. |
| 36 | + |
| 37 | +Our second notebook, `langgraph-tool-calling-agent`, shows an alternative to AgentExecutor for building a Llama 3 powered agent. |
| 38 | + |
| 39 | +--- |
| 40 | + |
| 41 | +### `LangGraph custom agent` |
| 42 | + |
| 43 | +Our third notebook, `langgraph-custom-agent`, shows how to build a Llama 3 powered agent without reliance on tool-calling. |
| 44 | + |
| 45 | +--- |
| 46 | + |
| 47 | +### `LangGraph RAG Agent` |
| 48 | + |
| 49 | +Our fourth notebook, `langgraph-rag-agent`, shows how to apply LangGraph to build a custom Llama 3 powered RAG agent that use ideas from 3 papers: |
| 50 | + |
| 51 | +* Corrective-RAG (CRAG) [paper](https://arxiv.org/pdf/2401.15884.pdf) uses self-grading on retrieved documents and web-search fallback if documents are not relevant. |
| 52 | +* Self-RAG [paper](https://arxiv.org/abs/2310.11511) adds self-grading on generations for hallucinations and for ability to answer the question. |
| 53 | +* Adaptive RAG [paper](https://arxiv.org/abs/2403.14403) routes queries between different RAG approaches based on their complexity. |
| 54 | + |
| 55 | +We implement each approach as a control flow in LangGraph: |
| 56 | +- **Planning:** The sequence of RAG steps (e.g., retrieval, grading, and generation) that we want the agent to take. |
| 57 | +- **Memory:** All the RAG-related information (input question, retrieved documents, etc) that we want to pass between steps. |
| 58 | +- **Tool use:** All the tools needed for RAG (e.g., decide web search or vectorstore retrieval based on the question). |
| 59 | + |
| 60 | +We will build from CRAG (blue, below) to Self-RAG (green) and finally to Adaptive RAG (red): |
| 61 | + |
| 62 | + |
| 63 | + |
| 64 | +--- |
| 65 | + |
| 66 | +### `Local LangGraph RAG Agent` |
| 67 | + |
| 68 | +Our fifth notebook, `langgraph-rag-agent-local`, shows how to apply LangGraph to build advanced RAG agents using Llama 3 that run locally and reliably. |
| 69 | + |
| 70 | +See this [video overview](https://www.youtube.com/watch?v=sgnrL7yo1TE) for more detail on the design of this agent. |
0 commit comments