v0.1.4

1. dynamically generate steps based on dom diff;
2. remove unused variables and prompt instructions
3. improve README SEO & recommend models

Author: mmmay0722

README.md

@@ -1,4 +1,16 @@
-<h1 align="center">WebQA Agent</h1>
+<!-- SEO Meta Information and Structured Data -->
+<div itemscope itemtype="https://schema.org/SoftwareApplication" align="center" xmlns="http://www.w3.org/1999/html">
+  <meta itemprop="name" content="WebQA Agent: Autonomous Web Testing & Quality Assurance">
+  <meta itemprop="description" content="AI-powered autonomous web browser agent that audits performance, functionality, UX, and security for comprehensive website testing and quality assurance">
+  <meta itemprop="applicationCategory" content="Web Testing Software">
+  <meta itemprop="operatingSystem" content="Cross-platform">
+  <meta itemprop="programmingLanguage" content="Python">
+  <meta itemprop="url" content="https://github.com/MigoXLab/webqa-agent">
+  <meta itemprop="softwareVersion" content="latest">
+  <meta itemprop="license" content="Apache-2.0">
+  <meta itemprop="keywords" content="vibecoding, web evaluation, autonomous, web testing, automation, AI testing, browser automation, quality assurance, performance testing, UX testing, security testing, functional testing">
+
+<h1 align="center" itemprop="name">WebQA Agent</h1>
 
 <!-- badges -->
 <p align="center">
@@ -11,12 +23,18 @@
 
 <p align="center">
   Try Demo 🤗<a href="https://huggingface.co/spaces/mmmay0722/WebQA-Agent">HuggingFace</a> | 🚀<a href="https://modelscope.cn/studios/mmmmei22/WebQA-Agent/summary">ModelScope</a><br>
-  Join us on 🎮<a href="https://discord.gg/K5TtkVcx">Discord</a> | 💬<a href="https://aicarrier.feishu.cn/docx/NRNXdIirXoSQEHxhaqjchUfenzd">WeChat</a>
+  Join us on 🎮<a href="https://discord.gg/fG5QAxYyNr">Discord</a> | 💬<a href="https://aicarrier.feishu.cn/docx/NRNXdIirXoSQEHxhaqjchUfenzd">WeChat</a>
 </p>
 
 <p align="center"><a href="README.md">English</a> · <a href="README_zh-CN.md">简体中文</a></p>
 
-<p align="center">🤖 <strong>WebQA Agent</strong> is an autonomous web browser agent that audits performance, functionality & UX for engineers and vibe-coding creators. ✨</p>
+<p align="center" itemprop="description">🤖 <strong>WebQA Agent</strong> is an autonomous web browser agent that audits performance, functionality & UX for engineers and vibe-coding creators. ✨</p>
+
+</div>
+
+<!-- Additional SEO Keywords and Context
+vibecoding, vibe coding, web evaluation, autonomous exploration, web testing automation, browser testing tool, AI-powered QA, automated web testing, website performance analysis, functional testing automation, user experience testing, UX, security vulnerability scanning, browser testing, web application testing, quality assurance automation, automated UI testing, web accessibility testing, performance monitoring, website audit tool, vibecoding testing, web development
+-->
 
 ## 🚀 Core Features
 
@@ -28,18 +46,26 @@
 
 ### 📋 Feature Highlights
 
-- **🤖 AI-Powered Testing**: WebQA Agent autonomously conducts website testing, from page crawling and test case generation to execution, achieving end-to-end functional test automation.
-- **📊 Multi-Dimensional Test**: Covers core testing scenarios, including functionality, performance, user experience, and security, evaluating page load speed, design details, and links for comprehensive system quality assurance.
-- **🎯 Precise Diagnostics**: Performs deep testing in real browser environments and provides actionable optimization recommendations.
-- **📈 Visual Reports**: Generates detailed HTML test reports with a multi-dimensional visual presentation of results for easy analysis and tracking.
+- **🤖 AI-Powered Testing**: Performs autonomous website testing—explores pages, plans actions, and executes end-to-end flows without manual scripting.
+- **📊 Multi-Dimensional Observation**: Covers functionality, performance, user experience, and basic security; evaluates load speed, design details, and links to surface issues.
+- **🎯 Actionable Recommendations**: Runs in real browsers and provides concrete suggestions for improvement.
+- **📈 Visual Reports**: Generates detailed HTML test reports with clear, multi-dimensional views for analysis and tracking.
+
+## 📹 Examples
 
+- **🤖 Conversational UI**: [Autonomously plans goals and interacts across a dynamic chat interface](https://pub-2c31c87660254d7bba9707e2b56fc15b.r2.dev/%E6%99%BA%E8%83%BDCase%E7%94%9F%E6%88%90.mp4)
+- **🎨 Creative Page**: [Explores page structure, identifies elements](https://pub-2c31c87660254d7bba9707e2b56fc15b.r2.dev/vibecoding.mp4)
+
+Try Demo: [🤗Hugging Face](https://huggingface.co/spaces/mmmay0722/WebQA-Agent) · [🚀ModelScope](https://modelscope.cn/studios/mmmmei22/WebQA-Agent/summary)
 
 ## Installation & Configuration
 
 ### 🚀 One-Click Docker Setup
 
 Before starting, ensure Docker is installed. If not, please refer to the official installation guide: [Docker Installation Guide](https://docs.docker.com/get-started/get-docker/).
 
+Recommended versions: Docker >= 24.0, Docker Compose >= 2.32.
+
 ```bash
 # 1. Download configuration template
 mkdir -p config && curl -fsSL https://raw.githubusercontent.com/MigoXLab/webqa-agent/main/config/config.yaml.example -o config/config.yaml
@@ -65,14 +91,14 @@ pip install -r requirements.txt
 playwright install
 ```
 
-Performance Testing - Lighthouse Installation (Optional)
+Performance Analysis - Lighthouse (Optional)
 
 ```bash
 # Requires Node.js >= 18.0.0
 npm install
 ```
 
-Security Testing - Nuclei Installation (Optional)
+Security Scanning - Nuclei (Optional)
 
 Download from: [Nuclei Releases](https://github.com/projectdiscovery/nuclei/releases/)
 
@@ -93,12 +119,6 @@ After configuring `config/config.yaml` (refer to "Usage > Test Configuration"),
 python webqa-agent.py
 ```
 
-## Online Demo
-
-🚀 **Try WebQA Agent Online:**
-- **Hugging Face Spaces**: [WebQA-Agent on Hugging Face](https://huggingface.co/spaces/mmmay0722/WebQA-Agent)
-- **ModelScope Studio**: [WebQA-Agent on ModelScope](https://modelscope.cn/studios/mmmmei22/WebQA-Agent/summary)
-
 ## Usage
 
 ### Test Configuration
@@ -117,9 +137,9 @@ test_config:                                      # Test configuration
     business_objectives: example business objectives  # Recommended to include test scope, e.g., test search functionality
   ux_test:                                        # User experience testing
     enabled: True
-  performance_test:                               # Performance testing
+  performance_test:                               # Performance analysis
     enabled: False
-  security_test:                                  # Security testing
+  security_test:                                  # Security scanning
     enabled: False
 
 llm_config:                                       # Vision model configuration, currently supports OpenAI SDK compatible format only
@@ -138,23 +158,34 @@ Please note the following important considerations when configuring and running
 
 #### 1. Functional Testing Notes
 
-- **AI Mode**: When specifying the number of test cases to generate in the configuration file, the system may re-plan based on based on actual testing conditions. This may result in the final number of executed test cases differing from the initial configuration to ensure testing accuracy and effectiveness.
+- **AI Mode**: When specifying the number of test cases to generate in the configuration file, the system may re-plan based on actual page conditions. This may result in the final number of executed test cases differing from the initial configuration to ensure coverage and effectiveness.
 
-- **Default Mode**: The `default` mode of functional testing primarily verifies whether UI element clicks execute successfully, including basic interactive functions like button clicks and link navigation.
+- **Default Mode**: The `default` mode focuses on whether UI interactions (e.g., clicks and navigations) complete successfully.
 
 #### 2. User Experience Testing Notes
 
-UX (User Experience) testing focuses on evaluating website interaction design, usability, and user-friendliness. The model output in the test results provides suggestions for improvement suggestions based on user experience best practices to guide development and design teams in optimization.
+UX (User Experience) testing focuses on usability, and user-friendliness. The model output in the results provides suggestions based on best practices to guide optimization.
+
+### 🧠 Recommended Models
+
+Based on our testing, these models work well with WebQA Agent:
+
+| Model | Key Strengths | Notes |
+|-------|---------------|-------|
+| **gpt-4.1-2025-04-14** ⭐ | High accuracy & reliability | **Best choice** |
+| **gpt-4.1-mini-2025-04-14** | Cost-effective | **Economical and practical**|
+| **doubao-seed-1-6-vision-250815n** | Vision capabilities | **Excellent web understanding** |
+
 
-## View Results
+### View Results
 
 Test results will be generated in the `reports` directory. Open the HTML report within the generated folder to view results.
 
 ## Roadmap
 
 1. Continuous optimization of AI functional testing: Improve coverage and accuracy
 2. Functional traversal and page validation: Verify business logic correctness and data integrity
-3. Interaction and visualization: Test case visualization and local service real-time reasoning process display
+3. Interaction and visualization: Test item visualization and local service real-time reasoning process display
 4. Capability expansion: Multi-model integration and more evaluation dimensions
 
 ## Acknowledgements

README_zh-CN.md

@@ -1,4 +1,16 @@
-<h1 align="center">WebQA Agent</h1>
+<!-- SEO Meta Information and Structured Data -->
+<div itemscope itemtype="https://schema.org/SoftwareApplication" align="center" xmlns="http://www.w3.org/1999/html">
+  <meta itemprop="name" content="WebQA Agent: 全自动网页测试与质量保证工具">
+  <meta itemprop="description" content="AI驱动的自主网页浏览器代理，提供性能、功能、用户体验和安全性的全面网站测试与质量保证服务">
+  <meta itemprop="applicationCategory" content="网页测试软件">
+  <meta itemprop="operatingSystem" content="跨平台">
+  <meta itemprop="programmingLanguage" content="Python">
+  <meta itemprop="url" content="https://github.com/MigoXLab/webqa-agent">
+  <meta itemprop="softwareVersion" content="latest">
+  <meta itemprop="license" content="Apache-2.0">
+  <meta itemprop="keywords" content="Vibecoding, 网页评估, 自主探索, 自动化, AI, 浏览器自动化, 网页质量保障, 网页性能, 用户体验, 安全检查, 网页功能, 功能测试"/>
+
+<h1 align="center" itemprop="name">WebQA Agent</h1>
 
 <!-- badges -->
 <p align="center">
@@ -17,6 +29,11 @@
 <p align="center"><a href="README.md">English</a> · <a href="README_zh-CN.md">简体中文</a></p>
 
 <p align="center">🤖 <strong>WebQA Agent</strong> 是全自动网页评估测试 Agent，一键完成性能、功能与交互体验的测试评估 ✨</p>
+</div>
+
+<!-- Additional SEO Keywords and Context
+Vibecoding, Vibe coding, 网页测试自动化, 浏览器测试工具, AI驱动质量保障, 自动化网页测试, 网站性能分析, 功能测试自动化, 用户体验测试, 安全漏洞扫描, 浏览器测试, 网页应用测试, 自动化UI测试, 网页可访问性测试, 性能监控, 网站审计工具, 智能测试用例生成, 端到端测试, 回归测试, 兼容性测试, Vibecoding测试, 网页开发
+-->
 
 ## 🚀 核心特性
 
@@ -28,18 +45,27 @@
 
 ### 📋 特性概览
 
-- **🤖 AI智能测试**：WebQA-Agent能够自主进行网站测试，从页面抓取、用例生成与执行，实现端到端功能测试自动化
-- **📊 多维度评估**：覆盖功能、性能、用户体验、安全等核心测试场景，评估页面加载速度、设计细节和链接，全面保障系统质量
-- **🎯 精准诊断**：基于真实浏览器环境的深度测试，提供可操作的优化建议
-- **📈 可视化报告**：生成详细的HTML测试报告，多维度、可视化展示测试结果，便于分析与追踪
+- **🤖 AI 自主测试**：WebQA-Agent能够自主进行网站测试，无需手写脚本，自动探索页面、规划动作并执行端到端流程
+- **📊 多维度观测**：覆盖功能、性能、用户体验、安全等核心场景，评估页面加载速度、设计细节和链接，全面保障系统质量
+- **🎯 可执行建议**：基于真实浏览器运行，输出具体的优化与改进建议
+- **📈 可视化报告**：生成详细的HTML测试报告，多维度、可视化展示执行结果，便于分析与追踪
+
+## 📹 示例演示
+
+- **🤖 对话界面**: [AI 自主生成目标与步骤，在动态聊天页面中理解上下文并执行](https://pub-2c31c87660254d7bba9707e2b56fc15b.r2.dev/%E6%99%BA%E8%83%BDCase%E7%94%9F%E6%88%90.mp4)
 
+- **🎨 静态页面**: [AI 自主探索页面结构、识别元素](https://pub-2c31c87660254d7bba9707e2b56fc15b.r2.dev/vibecoding.mp4)
+
+体验Demo： [🤗Hugging Face](https://huggingface.co/spaces/mmmay0722/WebQA-Agent) · [🚀ModelScope](https://modelscope.cn/studios/mmmmei22/WebQA-Agent/summary)
 
 ## 安装与配置
 
 ### 🚀 Docker一键启动
 
 在开始之前，请确保已安装 Docker。如未安装，请参考官方安装指南：[Docker 安装指南](https://docs.docker.com/get-started/get-docker/)。
 
+推荐版本： Docker >= 24.0, Docker Compose >= 2.32.
+
 ```bash
 # 1. 下载配置文件模板
 mkdir -p config && curl -fsSL https://raw.githubusercontent.com/MigoXLab/webqa-agent/main/config/config.yaml.example -o config/config.yaml
@@ -66,15 +92,15 @@ playwright install
 
 ```
 
-性能测试 - Lighthouse 安装（可选）
+性能分析 - Lighthouse 安装（可选）
 
 ```bash
 # 需要 Node.js >= 18.0.0 package.json
 npm install
 
 ```
 
-安全测试 - Nuclei 安装（可选）
+安全扫描 - Nuclei 安装（可选）
 
 下载地址： [Nuclei Releases](https://github.com/projectdiscovery/nuclei/releases/)
 
@@ -96,12 +122,6 @@ nuclei -version        # 验证安装成功
 python webqa-agent.py
 ```
 
-## 在线演示
-
-🚀 **在线体验 WebQA Agent:**
-- **Hugging Face Spaces**: [WebQA-Agent on Hugging Face](https://huggingface.co/spaces/mmmay0722/WebQA-Agent)
-- **ModelScope Studio**: [WebQA-Agent on ModelScope](https://modelscope.cn/studios/mmmmei22/WebQA-Agent/summary)
-
 ## 使用说明
 
 ### 测试配置
@@ -120,9 +140,9 @@ test_config:                                      # 测试项配置
     business_objectives: example business objectives  # 建议加入测试范围，如：测试搜索功能
   ux_test:                                        # 用户体验测试
     enabled: True
-  performance_test:                               # 性能测试
+  performance_test:                               # 性能分析
     enabled: False
-  security_test:                                  # 安全测试
+  security_test:                                  # 安全扫描
     enabled: False
 
 llm_config:                                       # 视觉模型配置，当前仅支持 OpenAI SDK 兼容格式
@@ -147,17 +167,27 @@ browser_config:
 
 #### 2. 用户体验测试说明
 
-UX（用户体验）测试专注于评估网站的交互设计、可用性和用户友好程度。测试结果中包含的模型输出内容是基于用户体验最佳实践提供的改进建议，供开发和设计团队参考优化。
+UX（用户体验）评估关注网页可用性与友好性。结果中的模型输出基于最佳实践给出改进建议，便于设计与开发参考。
+
+### 🧠 推荐模型
+
+基于实际测试结果，以下模型表现较好，推荐使用：
+
+| 模型 | 核心优势 | 使用建议 |
+|------|----------|----------|
+| **gpt-4.1-2025-04-14** ⭐ | 高准确性与可靠性 | **最佳选择** |
+| **gpt-4.1-mini-2025-04-14** | 性价比高 | **经济实用** |
+| **doubao-seed-1-6-vision-250815** | 支持视觉识别 | **网页理解优异** |
 
-## 查看结果
+### 查看结果
 
 在 `reports` 目录会生成本次测试的文件夹，打开其中的 HTML 报告即可查看结果。
 
 ## RoadMap
 
-1. AI功能测试持续优化：提升覆盖率与准确性
+1. AI智能功能功能测试持续优化：提升覆盖率与准确性
 2. 功能遍历与页面校验：校验业务逻辑正确性与数据完整性
-3. 交互与可视化：用例可视化与本地服务实时展示推理过程
+3. 交互与可视化：测试项可视化与本地服务实时展示推理过程
 4. 能力扩展：多模型接入与更多评估维度集成
 
 ## 致谢

webqa-agent.py

@@ -222,6 +222,7 @@ def build_test_configurations(cfg, cookies=None):
                     "test_specific_config": {
                         "cookies": cookies,
                         "business_objectives": tconf["function_test"].get("business_objectives", ""),
+                        "dynamic_step_generation": tconf["function_test"].get("dynamic_step_generation", {}),
                     },
                 }
             )

webqa_agent/crawler/deep_crawler.py

@@ -289,7 +289,8 @@ async def crawl(
                     current_url=page.url
                 )
 
-                logging.debug(f"DOM change result: {diff_elements}")
+                if diff_elements["has_changes"]:
+                    logging.debug(f"DOM change result: {diff_elements}")
 
                 result.diff_element_map = ElementMap(data=self.extract_interactive_elements(get_new_elems=True))
 

webqa_agent/executor/test_runners.py

@@ -59,6 +59,13 @@ async def run_test(
                 business_objectives = test_config.test_specific_config.get('business_objectives', '')
                 logging.info(f"{icon['running']} Running test: {test_config.test_name} with business objectives: {business_objectives}")
 
+                # Extract dynamic step generation configuration
+                dynamic_step_config = test_config.test_specific_config.get('dynamic_step_generation', {
+                    "enabled": False,
+                    "max_dynamic_steps": 5,
+                    "min_elements_threshold": 2
+                })
+
                 cookies = test_config.test_specific_config.get('cookies')
 
                 initial_state = {
@@ -72,6 +79,7 @@ async def run_test(
                     'current_test_case_index': 0,
                     'skip_reflection': False,  # Initialize skip reflection flag
                     'language': test_config.report_config.get('language', 'zh-CN'),
+                    'dynamic_step_generation': dynamic_step_config,  # Pass dynamic step generation config
                 }
 
                 graph_config = {'configurable': {'ui_tester_instance': parallel_tester}, 'recursion_limit': 100}