How to have the agent retrieve a URL?

[jimmyland22]

Hello,

I'm trying to replicate a workflow I often do in github copilot, is this possible in Librechat Agent?
I'll start off in VSCode and paste in a URL to a documentation page (like an API, or a library) and ask the agent to summarize and create a markdown file. Once the .md file is created, I'll reference it in my subsequent request to have it code things for me.

In Librechat, I have enabled the Google Search tool, but if I just paste in a URL, the agent doesn't seem to have a way to retrieve the page. Is there something else I need to enable?

[RicardoOM-AC]

Add this tool to LibreChat:

https://github.com/mendableai/firecrawl-mcp-server

Add a firecrawl api key and you are ready.

[jimmyland22]

Seems overkill to use another service just to retrieve a single webpage.

[tnsai]

It avoids hardcoding one-off instances and having to alter all dependent code where you need to access it.

Separation of concerns ensures that source code doesn't rapidly become a mess.

You could write a tool or function call spec in an agent that calls your own code to do the fetch if you like, or contribute a URL fetcher module to the project. Or alternatively just use the convenience and power of a service like Firecrawl. Plenty of choice.