Skip to content

Added a readme for fs-integration-test-suite#922

Open
De-Silva-Madhushankha wants to merge 1 commit intowso2:mainfrom
De-Silva-Madhushankha:De-Silva-Madhushankha-patch-1
Open

Added a readme for fs-integration-test-suite#922
De-Silva-Madhushankha wants to merge 1 commit intowso2:mainfrom
De-Silva-Madhushankha:De-Silva-Madhushankha-patch-1

Conversation

@De-Silva-Madhushankha
Copy link

@De-Silva-Madhushankha De-Silva-Madhushankha commented Mar 18, 2026

Added a readme for fs-integration-test-suite

Better to have a README to streamline configuring and running the test suite.

Issue link: closes #921


Development Checklist

  1. Build complete solution with pull request in place.
  2. Ran checkstyle plugin with pull request in place.
  3. Ran Findbugs plugin with pull request in place.
  4. Ran FindSecurityBugs plugin and verified report.
  5. Formatted code according to WSO2 code style.
  6. Have you verified the PR doesn't commit any keys, passwords, tokens, usernames, or other secrets?
  7. Migration scripts written (if applicable).
  8. Have you followed secure coding standards in WSO2 Secure Engineering Guidelines?

Testing Checklist

  1. Written unit tests.
  2. Verified tests in multiple database environments (if applicable).
  3. Tested with BI enabled (if applicable).

Summary by CodeRabbit

  • Documentation
    • Comprehensive README added for fs-integration-test-suite with project overview, repository structure, prerequisites, environment setup, configuration instructions, build and run procedures, test modules, reporting, and architecture details.

@coderabbitai
Copy link

coderabbitai bot commented Mar 18, 2026

Walkthrough

A comprehensive README documentation file is added to the fs-integration-test-suite project, covering project overview, repository structure, prerequisites, environment setup, TestConfiguration.xml configuration, build and run instructions, test modules, reporting, and architecture details. No code modifications.

Changes

Cohort / File(s) Summary
Documentation
fs-integration-test-suite/README.md
New comprehensive README documenting project overview, repository structure, prerequisite requirements, environment setup instructions, TestConfiguration.xml usage, build/run procedures, test module organization, reporting mechanisms, and architecture details.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Poem

🐰 A README so grand, now the path is quite clear,
No more reverse-engineering, the setup's right here!
With configuration flows and steps laid out neat,
Onboarding's a breeze—integration's complete! 📚✨

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Description check ⚠️ Warning The description includes the issue link and a brief explanation, but lacks most development and testing checklists required by the template. Complete the Development Checklist (items 1-5, 7-8) and Testing Checklist (items 1-3) as specified in the template to ensure all verification steps are documented.
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title 'Added a readme for fs-integration-test-suite' accurately reflects the main change—adding documentation for the integration test suite.
Linked Issues check ✅ Passed The added README comprehensively documents TestConfiguration.xml structure, setup instructions, configuration flow, and test execution—fulfilling all requirements from issue #921.
Out of Scope Changes check ✅ Passed The pull request solely adds documentation (README.md) with no code or configuration changes, remaining fully in scope with the objective to streamline test suite documentation.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
📝 Coding Plan
  • Generate coding plan for human review comments

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Tip

You can disable the changed files summary in the walkthrough.

Disable the reviews.changed_files_summary setting to disable the changed files summary in the walkthrough.

Copy link

@coderabbitai coderabbitai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 4

🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.

Inline comments:
In `@fs-integration-test-suite/README.md`:
- Line 343: The README uses mixed English spelling—this line says
"authorization" while earlier sections use "authorisation"; update this sentence
(the one mentioning the `is-setup` module and "user creation and API
authorization pre-steps") to use the project's chosen variant (match all other
occurrences, e.g., change "authorization" to "authorisation" or vice versa) so
the document is consistent across the file.
- Around line 138-139: Replace concrete example secrets with explicit
placeholders and add a short warning about not committing real credentials:
change values like the `wso2carbon` entry for `<Password>` and
`cIYo-5zX4OTWZpHrmmiZDVxACJM` for `<SigningKid>` to generic placeholders (e.g.,
<YOUR_PASSWORD>, <YOUR_SIGNING_KID>) and insert a one-line note such as "Do not
use real credentials—replace with placeholders and never commit secrets." Apply
the same replacement pattern to the other occurrences mentioned (near the blocks
referenced at 147-148, 166-167, 195-206, 245-249) so all example credentials are
placeholders.
- Around line 11-34: Update the fenced code block in README.md that displays the
directory tree (the block that starts with "fs-integration-test-suite/" and the
triple backticks) to include a language tag (e.g., change ``` to ```text) so
markdownlint MD040 is satisfied; modify the opening fence for that tree block
only, leaving the tree contents (lines containing "bfsi-test-framework",
"accelerator-tests", "test-artifacts", "pom.xml", etc.) unchanged.
- Around line 81-83: Update the fenced code block that contains the path
"fs-integration-test-suite/accelerator-test-framework/src/main/resources/TestConfiguration.xml"
to include a language tag to satisfy MD040; add the tag "text" immediately after
the opening backticks (i.e., change ``` to ```text) so the block becomes a text
fenced block.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: a3c05eef-af76-423c-8a69-34f0aa62562b

📥 Commits

Reviewing files that changed from the base of the PR and between c5c19d8 and a4d7b97.

📒 Files selected for processing (1)
  • fs-integration-test-suite/README.md

Comment on lines +11 to +34
```
fs-integration-test-suite/
├── bfsi-test-framework/ # Base BFSI test framework
├── accelerator-test-framework/ # FS Accelerator test framework & TestConfiguration
│ └── src/main/resources/
│ └── TestConfigurationExample.xml
├── accelerator-tests/
│ ├── is-tests/ # IS integration tests
│ │ ├── dcr/
│ │ ├── token/
│ │ ├── pre-configuration-step/
│ │ ├── consent-management/
│ │ └── event-notification/
│ └── gateway-tests/ # Gateway integration tests
│ ├── accounts/
│ ├── payments/
│ ├── cof/
│ ├── dcr/
│ ├── token/
│ ├── schema.validation/
│ └── non.regulatory.scenarios/
├── test-artifacts/ # Keystores, SSAs, and other test artifacts
└── pom.xml
```
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟡 Minor

Add a language tag to the fenced tree block.

The block should specify a language (for example text) to satisfy markdownlint MD040.

Suggested edit
-```
+```text
 fs-integration-test-suite/
 ├── bfsi-test-framework/          # Base BFSI test framework
 ...
 └── pom.xml
</details>

<!-- suggestion_start -->

<details>
<summary>📝 Committable suggestion</summary>

> ‼️ **IMPORTANT**
> Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.

```suggestion

🧰 Tools
🪛 markdownlint-cli2 (0.21.0)

[warning] 11-11: Fenced code blocks should have a language specified

(MD040, fenced-code-language)

🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@fs-integration-test-suite/README.md` around lines 11 - 34, Update the fenced
code block in README.md that displays the directory tree (the block that starts
with "fs-integration-test-suite/" and the triple backticks) to include a
language tag (e.g., change ``` to ```text) so markdownlint MD040 is satisfied;
modify the opening fence for that tree block only, leaving the tree contents
(lines containing "bfsi-test-framework", "accelerator-tests", "test-artifacts",
"pom.xml", etc.) unchanged.

Comment on lines +81 to +83
```
fs-integration-test-suite/accelerator-test-framework/src/main/resources/TestConfiguration.xml
```
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟡 Minor

Add a language tag to this fenced path block.

This also triggers MD040; use text for consistency.

Suggested edit
-```
+```text
 fs-integration-test-suite/accelerator-test-framework/src/main/resources/TestConfiguration.xml
</details>

<details>
<summary>🧰 Tools</summary>

<details>
<summary>🪛 markdownlint-cli2 (0.21.0)</summary>

[warning] 81-81: Fenced code blocks should have a language specified

(MD040, fenced-code-language)

</details>

</details>

<details>
<summary>🤖 Prompt for AI Agents</summary>

Verify each finding against the current code and only fix it if needed.

In @fs-integration-test-suite/README.md around lines 81 - 83, Update the fenced
code block that contains the path
"fs-integration-test-suite/accelerator-test-framework/src/main/resources/TestConfiguration.xml"
to include a language tag to satisfy MD040; add the tag "text" immediately after
the opening backticks (i.e., change totext) so the block becomes a text
fenced block.


</details>

<!-- fingerprinting:phantom:triton:hawk -->

<!-- This is an auto-generated comment by CodeRabbit -->

Comment on lines +138 to +139
| `<Password>` | Keystore password | `wso2carbon` |
| `<SigningKid>` | Key ID (`kid`) used in JWT headers | `cIYo-5zX4OTWZpHrmmiZDVxACJM` |
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟠 Major

Avoid realistic secrets in examples; use explicit placeholders.

Several snippets show concrete passwords/client secrets. Even in docs, this can normalize insecure copy-paste. Prefer placeholders and add a short “never commit real credentials” note.

Suggested edit pattern
-| `<Password>` | Keystore password | `wso2carbon` |
+| `<Password>` | Keystore password | `<CHANGE_ME>` |

-    <Password>testUser@wso2123</Password>
+    <Password><PSU_PASSWORD></Password>

-    <ISAdminPassword>wso2123</ISAdminPassword>
+    <ISAdminPassword><IS_ADMIN_PASSWORD></ISAdminPassword>

Also applies to: 147-148, 166-167, 195-206, 245-249

🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@fs-integration-test-suite/README.md` around lines 138 - 139, Replace concrete
example secrets with explicit placeholders and add a short warning about not
committing real credentials: change values like the `wso2carbon` entry for
`<Password>` and `cIYo-5zX4OTWZpHrmmiZDVxACJM` for `<SigningKid>` to generic
placeholders (e.g., <YOUR_PASSWORD>, <YOUR_SIGNING_KID>) and insert a one-line
note such as "Do not use real credentials—replace with placeholders and never
commit secrets." Apply the same replacement pattern to the other occurrences
mentioned (near the blocks referenced at 147-148, 166-167, 195-206, 245-249) so
all example credentials are placeholders.


- The `TestConfigurationExample.xml` must be copied to `TestConfiguration.xml` before running - the automated `test.sh` script does this automatically.

- The `is-setup` module is commented out in the IS test modules' `pom.xml` and is not run by default. It contains Groovy scripts for user creation and API authorization pre-steps.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Potential issue | 🟡 Minor

Keep one English variant for consistency.

This line uses authorization while earlier sections use authorisation. Pick one variant across the document (prefer repo/project convention).

🧰 Tools
🪛 LanguageTool

[uncategorized] ~343-~343: Do not mix variants of the same word (‘authorization’ and ‘authorisation’) within a single text.
Context: ...roovy scripts for user creation and API authorization pre-steps. - The `test-artifacts/Dynam...

(EN_WORD_COHERENCY)

🤖 Prompt for AI Agents
Verify each finding against the current code and only fix it if needed.

In `@fs-integration-test-suite/README.md` at line 343, The README uses mixed
English spelling—this line says "authorization" while earlier sections use
"authorisation"; update this sentence (the one mentioning the `is-setup` module
and "user creation and API authorization pre-steps") to use the project's chosen
variant (match all other occurrences, e.g., change "authorization" to
"authorisation" or vice versa) so the document is consistent across the file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add README for fs-integration-test-suite

1 participant