Merge branch 'MFTF3.0.0-RC2' into bugfix/544-missing-request-information

Author: okolesnyk

.travis.yml

@@ -1,14 +1,16 @@
 language: php
 php:
-  - 7.0
-  - 7.1
-  - 7.2
   - 7.3
+services:
+  - docker
+before_install:
+  - docker run -d -p 4444:4444 -v /dev/shm:/dev/shm selenium/standalone-chrome:3.141.59-zirconium
 install: composer install --no-interaction --prefer-source
 env:
   matrix:
     - VERIFICATION_TOOL=phpunit-checks
     - VERIFICATION_TOOL=static-checks
+    - VERIFICATION_TOOL=functional
 script:
   - bin/$VERIFICATION_TOOL
 after_success:

CHANGELOG.md

@@ -1,5 +1,99 @@
 Magento Functional Testing Framework Changelog
 ================================================
+3.0.0 RC1
+---------
+
+### Enhancements
+* Customizability
+    * Introduced MFTF helpers `<helper>` to create custom actions outside of MFTF.
+    * Removed deprecated actions `<executeSelenium>` and `<performOn>`.
+* Maintainability
+    * Schema updates for test entities to only allow single entity per file except Data and Metadata.
+    * Support for sub-folders in test modules.
+    * Removed support to read test entities from `<magento>dev/tests/acceptance/tests/functional/Magento/FunctionalTest`. 
+    * Removed support for PHP 7.0 and 7.1.
+    * Removed file attribute for `<module>` in suiteSchema.
+* Traceability
+    * Removed `--debug` option NONE to disallow ability to turn off schema validation.
+    * Notices added for test entity naming convention violations.
+    * Metadata file names changed to `*Meta.xml`.
+* Readability
+    * Support only nested assertion syntax [See assertions page for details](./docs/test/assertions.md)       
+* Upgrade scripts added to upgrade tests to MFTF major version requirements. See upgrade instructions below.
+* Bumped dependencies to latest possible versions.
+
+### Fixes
+* Throw exception during generation when leaving out .url for `amOnPage`.
+* `request_timeout` and `connection_timeout` added to functional.suite.yml.dist.
+* Fixed `ModuleResolver` to resolve test modules moved out of deprecated path.
+
+### Upgrade Instructions
+* Run `bin/mftf reset --hard` to remove old generated configurations.
+* Run `bin/mftf build:project` to generate new configurations.
+* Run `bin/mftf upgrade:tests`. [See command page for details](./docs/commands/mftf.md#upgradetests).
+* After running the above command, some tests may need manually updates:
+    * Remove all occurrences of `<executeInSelenium>` and `<performOn>`
+    * Remove all occurrences of `<module file=""/>` from any `<suite>`s
+    * Ensure all `<assert*>` actions in your tests have a valid schema.
+* Lastly, try to generate all tests. Tests should all be generated as a result of the upgrades.
+    * If not, the most likely issue will be a changed XML schema. Check error messaging and search your codebase for the attributes listed.
+
+2.6.3
+-----
+
+### New Feature
+* `--filter` option was added to `bin/mftf generate:tests` command. For more details please go to https://devdocs.magento.com/mftf/docs/commands/mftf.html#generatetests
+
+2.6.2
+-----
+
+### Fixes
+* Fixed float conversion error in test generation
+
+2.6.1
+-----
+
+* Usability
+    * Introduced new `.env` configuration `ELASTICSEARCH_VERSION` to support multiple elasticsearch versions
+* Maintainability
+    * Added deprecation notices for upcoming MFTF 3.0.0
+* Replaced facebook webdriver with php-webdriver to support PHP version updates
+
+2.6.0
+-----
+
+* Usability
+    * `magentoCron` action added by community maintainer @lbajsarowicz
+* Traceability
+    * MFTF generated cest files are fully compatible for Codeception `dry-run`.
+* Modularity
+    * `mftf generate:tests` and `mftf run:test` commands now accept suite scoped test names in format `[suitename:testname]...`.
+* Maintainability
+    * Support `deprecated` syntax for the following test entities:
+        * Test
+        * Action Group
+        * Data
+        * Metadata
+        * Page
+        * Section
+        * Section Element
+            * See DevDocs for details 
+    * Improved `mftf static-checks` command to allow executing all or specific static checks.
+    * Added a new static check that checks and reports unused arguments in action groups.
+* Customizability
+    * AWS Secrets Manager has been added as an additional credential storage.
+        * See DevDocs for details
+* Bumped dependencies to latest possible versions
+
+### Fixes
+* Fixed missing before, after, failed steps in cest file when generating tests with `--allow-skipped` option.
+* Fixed suites and tests display issue in Allure `Suites` page after `mftf run:group` command.
+* `createData` action now shows a meaningful error message at runtime when the entity does not exist.
+
+### GitHub Issues/Pull requests:
+* [#537](https://github.com/magento/magento2-functional-testing-framework/pull/537) -- Refactor of TestGenerator class
+* [#538](https://github.com/magento/magento2-functional-testing-framework/pull/538) -- FEATURE: <magentoCron> command to execute Cron Jobs
+
 2.5.4
 -----
 [Demo Video](https://www.youtube.com/watch?v=tguvkw1HWKg)

README.md

@@ -70,11 +70,11 @@ See the license [here][] or contact [[email protected]][] for a copy.
 
 <!-- Link Definitions -->
 [Getting Started]: docs/getting-started.md
-[Contribution Guidelines]: .github/CONTRIBUTING.html
+[Contribution Guidelines]: https://github.com/magento/magento2-functional-testing-framework/blob/develop/.github/CONTRIBUTING.md
 [DevDocs Contributing]: https://github.com/magento/devdocs/blob/master/.github/CONTRIBUTING.md
 [[email protected]]: mailto:[email protected]
 [encryption key]: https://info2.magento.com/rs/magentoenterprise/images/security_at_magento.asc
 [here]: https://magento.com/security/reporting-magento-security-issue
 [Security Alert Notifications]: https://magento.com/security/sign-up
 [here]: LICENSE_AGPL3.txt
-[[email protected]]: mailto:[email protected]
+[[email protected]]: mailto:[email protected]

bin/functional

@@ -0,0 +1,10 @@
+# Copyright © Magento, Inc. All rights reserved.
+# See COPYING.txt for license details.
+
+set -e
+
+echo "==============================="
+echo "      EXECUTE DevDocsTest      "
+echo "==============================="
+bin/mftf build:project
+bin/mftf run:test DevDocsTest -f

composer.json

@@ -2,53 +2,61 @@
     "name": "magento/magento2-functional-testing-framework",
     "description": "Magento2 Functional Testing Framework",
     "type": "library",
-    "version": "2.5.4",
+    "version": "3.0.0",
     "license": "AGPL-3.0",
     "keywords": ["magento", "automation", "functional", "testing"],
     "config": {
         "sort-packages": true
     },
     "require": {
-        "php": "7.0.2||7.0.4||~7.0.6||~7.1.0||~7.2.0||~7.3.0",
+        "php": "^7.3",
         "ext-curl": "*",
+        "ext-dom": "*",
         "ext-json": "*",
         "ext-openssl": "*",
-        "allure-framework/allure-codeception": "~1.3.0",
+        "allure-framework/allure-codeception": "~1.4.0",
         "aws/aws-sdk-php": "^3.132",
-        "codeception/codeception": "~2.4.5",
-        "composer/composer": "^1.4",
-        "consolidation/robo": "^1.0.0",
+        "codeception/codeception": "~4.1.4",
+        "codeception/module-asserts": "^1.1",
+        "codeception/module-sequence": "^1.0",
+        "codeception/module-webdriver": "^1.0",
+        "composer/composer": "^1.6",
         "csharpru/vault-php": "~3.5.3",
         "csharpru/vault-php-guzzle6-transport": "^2.0",
-        "flow/jsonpath": ">0.2",
-        "fzaninotto/faker": "^1.6",
         "monolog/monolog": "^1.0",
         "mustache/mustache": "~2.5",
-        "symfony/process": "^2.8 || ^3.1 || ^4.0",
+        "php-webdriver/webdriver": "^1.8.0",
+        "symfony/console": "^4.4",
+        "symfony/finder": "^4.4",
+        "symfony/mime": "^5.0",
+        "symfony/process": "^4.4",
         "vlucas/phpdotenv": "^2.4"
     },
     "require-dev": {
         "squizlabs/php_codesniffer": "~3.2",
-        "sebastian/phpcpd": "~3.0 || ~4.0",
+        "sebastian/phpcpd": "~4.0||~5.0",
         "brainmaestro/composer-git-hooks": "^2.3.1",
         "doctrine/cache": "<1.7.0",
         "codeception/aspect-mock": "^3.0",
         "goaop/framework": "2.2.0",
         "codacy/coverage": "^1.4",
         "phpmd/phpmd": "^2.6.0",
-        "phpunit/phpunit": "~6.5.0 || ~7.0.0",
+        "phpunit/phpunit": "~9.0.0",
         "rregeer/phpunit-coverage-check": "^0.1.4",
         "php-coveralls/php-coveralls": "^1.0",
         "symfony/stopwatch": "~3.4.6"
     },
     "suggest": {
         "epfremme/swagger-php": "^2.0"
     },
+    "replace": {
+        "facebook/webdriver": "^1.7.1"
+    },
     "autoload": {
         "files": ["src/Magento/FunctionalTestingFramework/_bootstrap.php"],
         "psr-4": {
             "Magento\\FunctionalTestingFramework\\": "src/Magento/FunctionalTestingFramework",
-            "MFTF\\": "dev/tests/functional/MFTF"
+            "MFTF\\": "dev/tests/functional/tests/MFTF"
         }
     },
     "autoload-dev": {