diff --git a/cypress.config.ts b/cypress.config.ts index ce486443e2..3f90e8524e 100644 --- a/cypress.config.ts +++ b/cypress.config.ts @@ -8,6 +8,10 @@ export default defineConfig({ viewportHeight: 800, viewportWidth: 1200, experimentalMemoryManagement: true, + retries: { + runMode: 2, + openMode: 0, + }, e2e: { supportFile: false, baseUrl: "http://localhost:3000", diff --git a/docs/cloud/account-management/data-storage-and-masking.mdx b/docs/cloud/account-management/data-storage-and-masking.mdx index 138ba116b7..9d18bdd99c 100644 --- a/docs/cloud/account-management/data-storage-and-masking.mdx +++ b/docs/cloud/account-management/data-storage-and-masking.mdx @@ -13,7 +13,7 @@ sidebar_label: Data Storage and Controls ##### What you'll learn -- What data is stored in Cypress Cloud +- What data is stored in Cypress Cloud and how it is used - How to control what data is sent to Cypress Cloud - How to mask data in screenshots and videos - How to control what is shown in the Cypress Command Log and network requests @@ -22,10 +22,12 @@ sidebar_label: Data Storage and Controls :::caution -Please refer to the [Cypress Cloud Terms of Use](https://cloud.cypress.io/terms-of-use) and our [Security & Compliance](https://www.cypress.io/security/) guide for more specifics around reasonable use of Cypress Cloud, data storage and security at Cypress. +Please refer to the [Cypress Cloud Terms of Use](https://cypress.io/terms-of-use) and our [Security & Compliance](https://on.cypress.io/security/) guide for more specifics around reasonable use of Cypress Cloud, data storage and security at Cypress. ::: +## Types of Data + When you run Cypress via `cypress run` and pass the `--record` flag, the following data is stored in Cypress Cloud for every run: - Standard output in the terminal @@ -45,9 +47,11 @@ When [Test Replay](/cloud/features/test-replay) capturing is enabled, the additi Cypress Cloud does not capture anything related to the code of your application under test or the code within any repositories that are associated with your project. +When [Cloud AI](/cloud/faq#What-is-Cloud-AI) is enabled, test content may be shared with session-bound AI model to enhance your test management experience. Your data is not used to train AI models and will not be shared between customers. + You, the customer, own and are responsible for your test content. We trust that customers will make decisions about the appropriateness of data to use in testing and will avoid use of PII, PHI, or other types of protected information. Cypress makes commercially reasonable efforts to protect confidentiality of information that is provided to Cypress Cloud. -## Types of Data +## Data Controls We understand that controlling what data is sent to Cypress Cloud is important to our users. Cypress provides a number of ways to control what data is sent to Cypress Cloud. @@ -174,6 +178,17 @@ Cypress allows users to block requests from specified hosts. [See our blockHosts alt="Network tab of dev tools showing blocked host" /> +### Cloud AI controls + +[Cloud AI](/cloud/faq#What-is-Cloud-AI) is enabled by default for all users on any Cloud plan. + +Organization admins and owners can enable and disable the AI capabilities for their entire organization from the organization settings. + + + ## See Also - [Cypress Cloud FAQ](/cloud/faq) diff --git a/docs/cloud/account-management/organizations.mdx b/docs/cloud/account-management/organizations.mdx index 0a08d9af06..66062d80af 100644 --- a/docs/cloud/account-management/organizations.mdx +++ b/docs/cloud/account-management/organizations.mdx @@ -2,7 +2,7 @@ title: 'Manage organizations | Cypress Cloud' description: 'Learn how to create projects, manage users, access billing and usage information, leverage third party integrations, and apply org-level settings.' sidebar_label: Organizations -sidebar_position: 20 +sidebar_position: 10 --- @@ -52,6 +52,25 @@ switcher and clicking ** Create new organization**. alt="Create new organization" /> +### Manage Projects + +Once you create an organization, a new "Default Project" will be created for you. From here, you can adjust your [Project Settings](/cloud/account-management/projects#Project-settings) to fit your needs. + +### Manage Users and Teams + +Organization owner or admin roles can [invite Cypress Cloud users](/cloud/account-management/users) to their organization. Those invited can be [assigned to a team](/cloud/account-management/teams). A team can help you control which users have access to specific projects and tests. + +### Manage Cloud AI + +[Cloud AI](/cloud/faq#What-is-Cloud-AI) is enabled by default for all users on any Cloud plan. + +Organization admins and owners can enable and disable the AI capabilities for their entire organization from the organization settings. + + + ### Delete Org You can delete organizations that you own as long as they do not have any @@ -92,4 +111,10 @@ See our integration guides to learn more: - [Cypress integration for Slack guide](/cloud/integrations/slack) - [Cypress integration for Microsoft Teams guide](/cloud/integrations/teams) +### Enterprise SSO Authentication + +- [Okta](/cloud/account-management/enterprise-sso#Okta) +- [SAML](/cloud/account-management/enterprise-sso#SAML) +- [Azure AD](/cloud/account-management/enterprise-sso#Azure-AD) + {/* prettier-ignore-end */} diff --git a/docs/cloud/account-management/projects.mdx b/docs/cloud/account-management/projects.mdx index 24f4bcdb54..385ae62644 100644 --- a/docs/cloud/account-management/projects.mdx +++ b/docs/cloud/account-management/projects.mdx @@ -2,7 +2,7 @@ title: 'How to manage projects | Cypress Cloud' description: 'Learn how to set up a project to record test runs, manage project settings, transfer ownership of a project, and how to integrate with third party integrations.' sidebar_label: Projects -sidebar_position: 10 +sidebar_position: 20 --- diff --git a/docs/cloud/faq.mdx b/docs/cloud/faq.mdx index d74bb638c2..c1f2797e35 100644 --- a/docs/cloud/faq.mdx +++ b/docs/cloud/faq.mdx @@ -363,3 +363,53 @@ All of the data within Test Replay's Developer Tools in Cypress Cloud (including ### Can I `console.log()` data in the console view of the Developer Tools panel? Yes. This displays console logs from within the application under test or your spec files. You may need to use `JSON.stringify(Object)` to display deeply nested data. + +## Cloud AI :sparkles: + +### What is Cloud AI? + +Cloud AI is a collection of AI capabilities available in Cypress Cloud. These capabilities are continuously being added to the Cloud to improve the range of insights available in the Cloud and make it easier to accomplish tasks. + +The current Cloud AI capabilities include: + +- [Test Intent Summaries](/cloud/features/recorded-runs#Test-Intent-Summary-sparkles) - Understand what tests do without reading every command +- _(coming soon)_ Test Error Context - Plain language explanations of what went wrong in your failed tests +- Premium Solution [UI Coverage Test Generation](/ui-coverage/guides/address-coverage-gaps#Generate-Targeted-Tests-sparkles) + - Generate tests directly from coverage gaps found during code reviews + +### Are all Cloud AI capabilities enabled by default? How can I turn them off? + +Cloud AI capabilities are enabled by default for all users on any Cloud plan, with [UI Coverage Test Generation](/ui-coverage/guides/address-coverage-gaps#Generate-Targeted-Tests-sparkles) being limited to UI Coverage users. + +Organization admins and owners can enable and disable the AI capabilities for their entire organization from their organization settings. + + + +### How much does Cloud AI cost? + +Cloud AI capabilities are included at no additional cost on your existing plan: + +- [Test Intent Summaries](/cloud/features/recorded-runs#Test-Intent-Summary-sparkles) - available in all Cloud plans +- _(coming soon)_ Test Error Context - available in all Cloud plans +- Premium Solution [UI Coverage Test Generation](/ui-coverage/guides/address-coverage-gaps#Generate-Targeted-Tests-sparkles) + - included with UI Coverage + +### How is my data handled? + +Review [Cypress AI Security](https://on.cypress.io/ai-security) to learn how your data is handled. + +To summarize: + +- Your data is _not_ used to train AI models +- All data is processed and stored in Cypress's managed Cloud infrastructure +- All information shared with AI models is session-bound +- Data is _not_ shared between customers +- Personally identifiable information (PII) related to your Cypress Cloud account is never shared with the AI model +- Test content may be shared with AI models, and is _your_ responsibility as the customer to make decisions about the appropriateness of data used in testing and will avoid the use of PII, PHI, or other types of protected information. + +### Does Cypress use my data to train models? + +No, your data is not used to train models. diff --git a/docs/cloud/features/recorded-runs.mdx b/docs/cloud/features/recorded-runs.mdx index 3d5d6c88f1..111be0a301 100644 --- a/docs/cloud/features/recorded-runs.mdx +++ b/docs/cloud/features/recorded-runs.mdx @@ -215,6 +215,15 @@ to raise tickets on integrated project management systems or view artifacts. +### Test Intent Summary :sparkles: + +The Test Intent Summary is a Cypress Cloud AI capability. It is an AI-generated summary of the test's purpose to help you understand the goal of a test without needing to review each command or watch the entire Test Replay. This allows you to immediately focus your goal, whether it be reviewing the test or debugging an issue, saving you time. + + + ### Attempts and errors Stack traces, error message, and point-of-failure code frames for each attempt diff --git a/static/img/cloud/runs/sidebar-test-intent-summary.png b/static/img/cloud/runs/sidebar-test-intent-summary.png new file mode 100644 index 0000000000..d284a972f7 Binary files /dev/null and b/static/img/cloud/runs/sidebar-test-intent-summary.png differ diff --git a/static/img/faq/questions/cypress-ai-org-setting.png b/static/img/faq/questions/cypress-ai-org-setting.png new file mode 100644 index 0000000000..bdc36ca426 Binary files /dev/null and b/static/img/faq/questions/cypress-ai-org-setting.png differ