[Question]: I cannot figure out if Internet access works in librechat?

[virtuman]

What is your question?

Hello, can you please explain if librechat has functionality to scrape web pages or is it on the roadmap?

More Details

scrape webpages would be nice to have. chatgpt does it already. maybe Google search is what i should be looking at?

What is the main subject of your question?

No response

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[fuegovic]

We have a couple of plugins that can access the internet, for both the plugins endpoint and the assistants endpoint.

[virtuman]

could you elaborate on how to use it? and whether i need to spin up any headless browsers or something on my infrastructure to improve performance and accessibility of javascript-based websites?

[danny-avila]

none of the plugins do any complex scraping like that. some do proprietary methods of search engine retrieval, like Tavily

I would like to set my sights on this when I am implementing RAG for the project.

[myroslav]

@danny-avila, have you considered Browser-Use? It is available under MIT license for local setup. It can "see" the page (screenshot), if vision is enabled. For "easy start" hosted (cloud) option is available.

BTW there is already MCP server that wraps browser-use/web-ui.