changes to test plan and test doc

Author: surajrdy-aws

docs/TESTPLAN.md

@@ -41,7 +41,7 @@ The test suite has the following categories of tests:
 -   E2E Tests: **slow** tests
     -   Live in `src/testE2E`
     -   These tests are heavier than Integration tests.
-    -   Some E2E tests have a more complicated architecture, described in [TEST_E2E](./TEST_E2E.md)
+    -   Some E2E tests have a more complicated architecture, described in [UI_E2E_Test](./UI_E2E_Test.md)
 -   Performance Tests: **slow** tests
     -   Live in `src/testInteg/perf`.
     -   A subset of integration tests focused on catching performance regressions.

docs/UI_E2E_Test.md

@@ -0,0 +1,139 @@
+## UI Testing
+
+UI tests use [vscode-extension-tester](https://github.com/redhat-developer/vscode-extension-tester) to test the Amazon Q extension in a real VS Code environment.
+
+### Quick Start
+
+```bash
+# Run complete UI test suite
+npm run test:ui
+```
+
+### Individual Commands
+
+#### `test:ui:prepare`
+
+Downloads VS Code and ChromeDriver to `~/.vscode-test-resources`
+
+```bash
+npm run test:ui:prepare
+```
+
+#### `test:ui:install`
+
+Packages the Amazon Q extension and installs it for testing
+
+```bash
+npm run test:ui:install
+```
+
+-   Runs `npm run package` in amazonq directory
+-   Extracts version from build output
+-   Installs VSIX using `extest install-vsix`
+-   Sets up extension in test environment
+
+#### `test:ui:run`
+
+Compiles TypeScript and runs UI tests
+
+```bash
+npm run test:ui:run
+```
+
+-   Compiles test files with `npm run testCompile`
+-   Runs tests matching `packages/amazonq/dist/test/e2e_new/amazonq/tests/*.js`
+
+### E2E New Test Suite
+
+Modern UI testing framework located at `packages/amazonq/test/e2e_new/amazonq/`
+
+#### Directory Structure
+
+```
+packages/amazonq/test/e2e_new/amazonq/
+├── tests/            # Test files
+│   ├── chat.test.ts
+│   ├── pinContext.test.ts
+│   ├── quickActions.test.ts
+│   └── switchModel.test.ts
+├── helpers/          # Test helpers
+│   ├── pinContextHelper.ts
+│   ├── quickActionsHelper.ts
+│   └── switchModelHelper.ts
+├── utils/            # Testing utilities
+│   ├── authUtils.ts
+│   ├── cleanupUtils.ts
+│   ├── generalUtils.ts
+│   ├── setup.ts
+│   └── testContext.ts
+└── resources/        # Extension config
+    └── extensions.json
+```
+
+#### Test Categories
+
+-   **Chat** - Amazon Q chat functionality
+-   **Pin Context** - Context pinning features
+-   **Quick Actions** - Quick action commands
+-   **Switch Model** - Model switching functionality
+
+### Writing New Tests
+
+1. Create test files in `packages/amazonq/test/e2e_new/amazonq/tests/`
+2. Import utilities from `../utils/`
+3. Use helpers from `../helpers/`
+4. Follow existing patterns for setup/cleanup
+
+#### Example Test Structure
+
+```typescript
+import { describe, it, before, after } from 'mocha'
+import { setupTestContext, cleanupTestContext } from '../utils/setup'
+
+describe('Feature Tests', () => {
+    before(async () => {
+        await setupTestContext()
+    })
+
+    after(async () => {
+        await cleanupTestContext()
+    })
+
+    it('should test functionality', async () => {
+        // Test implementation
+    })
+})
+```
+
+### Prerequisites
+
+-   Node.js and npm
+-   VS Code extension development environment
+-   Chrome/Chromium browser
+
+### Troubleshooting
+
+#### Common Issues
+
+-   **VS Code download fails**: Check internet connection, retry `test:ui:prepare`
+-   **Extension install fails**: Ensure packaging succeeds
+-   **Tests won't start**: Verify ChromeDriver/Chrome compatibility
+-   **Permission errors**: Check `~/.vscode-test-resources` permissions
+
+#### Debug and Reset
+
+```bash
+# Debug mode
+DEBUG=true npm run test:ui:run
+
+# Reset test environment
+rm -rf ~/.vscode-test-resources
+npm run test:ui:prepare
+```
+
+### Test Development Tips
+
+-   Tests should be independent and run in any order
+-   Use existing utilities for common operations
+-   Clean up resources in `after` hooks
+-   Follow naming conventions from existing tests