Skip to content

可以优化优化brower-use库的使用嘛? 尤其是函数async def _get_interactive_elements(self) -> List[str]: #144

@caoyf1997-ops

Description

@caoyf1997-ops

async def _get_interactive_elements(self) -> List[str]:
函数提取不到页面有用元素,点击计算器网站根本无法完成正常的点击和计算,playwright 也不行,但是理论上brower-use效果应该可以更好一些

Image

日志:
NFO [main] Step 298: 打开计算器网站https://www.leaftools.net/calculator在网站上点击,计算从1加到100的和 ====LLM====input===== [SystemMessage(content='You are a browser automation agent. Accomplish the given task by calling browser tools step by step. After each navigation or interaction, call browser_view to observe the page state. When the task is fully done, stop calling tools and reply with a final summary.', additional_kwargs={}, response_metadata={}), HumanMessage(content='打开计算器网站https://www.leaftools.net/calculator在网站上点击,计算从1加到100的和', additional_kwargs={}, response_metadata={}), AIMessage(content='', additional_kwargs={'tool_calls': [{'id': 'call_d0b2cfa06213427d8ba85a', 'function': {'arguments': '{"url": "https://www.leaftools.net/calculator"}', 'name': 'browser_navigate'}, 'type': 'function', 'index': 0}], 'refusal': None}, response_metadata={'token_usage': {'completion_tokens': 29, 'prompt_tokens': 1450, 'total_tokens': 1479, 'completion_tokens_details': None, 'prompt_tokens_details': None}, 'model_name': 'qwen-plus-latest', 'system_fingerprint': None, 'id': 'chatcmpl-8eeb4f99-a2cf-97d5-9f62-cbef1f9c5629', 'service_tier': None, 'finish_reason': 'tool_calls', 'logprobs': None}, id='run--13cb540f-1fa3-4292-a8e1-3045c93c0392-0', tool_calls=[{'name': 'browser_navigate', 'args': {'url': 'https://www.leaftools.net/calculator'}, 'id': 'call_d0b2cfa06213427d8ba85a', 'type': 'tool_call'}], usage_metadata={'input_tokens': 1450, 'output_tokens': 29, 'total_tokens': 1479, 'input_token_details': {}, 'output_token_details': {}}), ToolMessage(content='{"success":true,"message":null,"data":{"interactive_elements":[]}}', name='browser_navigate', tool_call_id='call_d0b2cfa06213427d8ba85a'), AIMessage(content='', additional_kwargs={'tool_calls': [{'id': 'call_dadaf2f1c06c403a98e439', 'function': {'arguments': '{}', 'name': 'browser_view'}, 'type': 'function', 'index': 0}], 'refusal': None}, response_metadata={'token_usage': {'completion_tokens': 15, 'prompt_tokens': 1508, 'total_tokens': 1523, 'completion_tokens_details': None, 'prompt_tokens_details': None}, 'model_name': 'qwen-plus-latest', 'system_fingerprint': None, 'id': 'chatcmpl-df061cb6-e46b-936d-8933-5c29b9db52bf', 'service_tier': None, 'finish_reason': 'tool_calls', 'logprobs': None}, id='run--1860dd9e-cdfb-4527-8f7e-ebd03fb42d70-0', tool_calls=[{'name': 'browser_view', 'args': {}, 'id': 'call_dadaf2f1c06c403a98e439', 'type': 'tool_call'}], usage_metadata={'input_tokens': 1508, 'output_tokens': 15, 'total_tokens': 1523, 'input_token_details': {}, 'output_token_details': {}}), ToolMessage(content='{"success":true,"message":null,"data":{"interactive_elements":["3:<div class=\"btn\">5","13:首页","14:工具","15:博客","16:","18:<div class=\"layui-unselect layui-form-switch\">","20:<div class=\"btn\">C","21:<div class=\"btn\">CE","22:<div class=\"btn\">","23:<div class=\"btn\">/","24:<div class=\"btn\">1","25:<div class=\"btn\">2","26:<div class=\"btn\">3","27:<div class=\"btn\">","28:<div class=\"btn\">4","29:<div class=\"btn\">6","30:<div class=\"btn\">","31:<div class=\"btn\">7","32:<div class=\"btn\">8","33:<div class=\"btn\">9","34:<div class=\"btn\">","35:<div class=\"btn\">","36:<div class=\"btn\">0","37:<div class=\"btn\">.","38:<div class=\"btn\">=","91:<i class=\"layui-icon layui-icon-leaf layui-font-24\">","127:<div class=\"layui-form ws-header-theme\">|","129:

","131:<i class=\"layui-icon layui-icon-light\">","134:","157:<li class=\"layui-menu-item-gr

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions